-- Logs begin at Tue 2022-07-12 16:42:34 UTC, end at Tue 2022-07-12 17:44:32 UTC. -- Jul 12 17:12:38.277093 dv-cinder-849325-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 17:12:38.286242 dv-cinder-849325-2-smb devstack@keystone.service[80303]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 17:12:38 2022] *** Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: nodename: dv-cinder-849325-2-smb Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: machine: x86_64 Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: clock source: unix Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: pcre jit disabled Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: detected number of CPU cores: 4 Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: current working directory: / Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: detected binary path: /usr/bin/uwsgi-core Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: your processes number limit is 47680 Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: your memory page size is 4096 bytes Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: detected max file descriptor number: 2048 Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: lock engine: pthread robust mutexes Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: thunder lock: enabled Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 17:12:38.297921 dv-cinder-849325-2-smb devstack@keystone.service[80303]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 17:12:38.332740 dv-cinder-849325-2-smb devstack@keystone.service[80303]: Python main interpreter initialized at 0x5615312bf9c0 Jul 12 17:12:38.332740 dv-cinder-849325-2-smb devstack@keystone.service[80303]: python threads support enabled Jul 12 17:12:38.332740 dv-cinder-849325-2-smb devstack@keystone.service[80303]: your server socket listen backlog is limited to 100 connections Jul 12 17:12:38.332740 dv-cinder-849325-2-smb devstack@keystone.service[80303]: your mercy for graceful operations on workers is 90 seconds Jul 12 17:12:38.333083 dv-cinder-849325-2-smb devstack@keystone.service[80303]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 17:12:38.333156 dv-cinder-849325-2-smb devstack@keystone.service[80303]: *** Operational MODE: preforking *** Jul 12 17:12:38.333443 dv-cinder-849325-2-smb devstack@keystone.service[80303]: *** uWSGI is running in multiple interpreter mode *** Jul 12 17:12:38.333443 dv-cinder-849325-2-smb devstack@keystone.service[80303]: spawned uWSGI master process (pid: 80303) Jul 12 17:12:38.333663 dv-cinder-849325-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 17:12:38.335335 dv-cinder-849325-2-smb devstack@keystone.service[80303]: spawned uWSGI worker 1 (pid: 80315, cores: 1) Jul 12 17:12:38.335335 dv-cinder-849325-2-smb devstack@keystone.service[80303]: spawned uWSGI worker 2 (pid: 80316, cores: 1) Jul 12 17:12:38.335335 dv-cinder-849325-2-smb devstack@keystone.service[80303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 17:12:43.710178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:12:43.710178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jul 12 17:12:43.711013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:12:43.711013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: from cryptography.utils import int_from_bytes Jul 12 17:12:43.719529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:12:43.719529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jul 12 17:12:43.720001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 17:12:43.720001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: from cryptography.utils import int_from_bytes Jul 12 17:12:43.760213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:12:43.760395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:12:43.760623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] command line args: [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:12:43.760913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:12:43.761118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ================================================================================ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:12:43.761409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.761685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_dir = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.761874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.762039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] config_source = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.762242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] debug = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.762439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.762820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.762993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.763245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.763490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.763746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.763898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_config_append = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.764071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.764232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_dir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.764409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.764682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.764886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.765132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.765413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.765596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.765773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.766023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.766265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.766522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.766754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.766985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.767217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.767371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 17:12:43.767459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.767576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 17:12:43.767690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.767767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] command line args: [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 17:12:43.767970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.768052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 17:12:43.768197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ================================================================================ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 17:12:43.768464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.768546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.768631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] publish_errors = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.768716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_dir = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.768870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.768945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] config_source = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] debug = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.769925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] standard_threads = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_journal = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_config_append = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_json = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.770972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_stderr = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_dir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] use_syslog = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.771802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.771963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.772035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.772219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.772313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.772381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.772440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.772565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.772698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.772811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.772934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.773058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.773181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.773290 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.773422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.773523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.773650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.773755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.773897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.773973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.774148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.774230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.774410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.774488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.774659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.774736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.774896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.775142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.775225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.775396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] publish_errors = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.775497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.775627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.775711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.775857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.775940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.776035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.776122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.776281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.776362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.776512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.776587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.776746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] standard_threads = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.776832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.776976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.777051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.777220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.777297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.777396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.777539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.777615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_journal = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.777734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_json = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.777809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.777909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_stderr = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.777985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.778085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] use_syslog = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.778206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.778350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 17:12:43.778466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.778611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.778715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.778869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.778964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.779913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.780883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.781097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.781195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.781332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.781583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.781838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.781914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.782929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.783856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.784964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785429 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.785993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.786948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787196 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.787888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.788989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.789978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.790911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.791890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.792992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.793903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.794938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.795870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.external = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.796988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.797254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.797605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.797771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.797901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.password = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] auth.token = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.798953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.799940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800393 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.800991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.801966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.802936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803153 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.803935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.external = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.804983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.password = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] auth.token = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.805889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.806983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807542 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.807988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.808930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.809932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.810955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.811892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.812001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.812110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.812218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.812335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.812639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.812872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.812985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.813957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.814928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.815940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.816890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.817893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.818968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819515 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.819967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.820981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.821906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.822887 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.823897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.824886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.825939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.826991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.827129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.827244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.827376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.827490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.827599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.827711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.827870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.828081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.828200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.828309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.828419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.828600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.828851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.829946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.830929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.831957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.832894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833515 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.833962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.834105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.834218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.834387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.834558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.834737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.834978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.835153 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.835333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.835333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.835691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.835896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.836079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.836079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.836408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.836582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.836785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.836959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.837973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.838927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839595 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.839837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.840001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.840184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.840368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.840551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.840768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.840937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.841943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.842975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.843084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.843194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.843312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.843459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.843598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.843874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.843874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.844996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.845181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.845369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.845369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.845369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.845877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.846053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.846228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.846228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.846653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.846837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.847014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.847199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.847383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.847563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.847770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80316) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.849847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.849847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.849847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.849847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.849847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.849847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.850471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.850471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.850471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.850772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.851017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.851265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.851517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.851760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.852004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.852243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.852492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.852732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.852975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.853225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.853465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.853711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.853947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.854201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.854467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.854715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.854948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.855192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.855428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 17:12:43.855593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80315) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 17:12:43.878391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.878615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.878843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.884122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.884361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.884596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.887418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.893652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.916011 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.916241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.920941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:43.921174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.064589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.067441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.113660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.113835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.115357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.115596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.179869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.180047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.180296 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.180487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.180736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.180943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.181108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.181347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.181589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.181807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.182022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.182234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.206950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.207222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.207485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.207709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.207831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.207912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.207974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.208210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.208340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.208474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.208553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.208553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.208802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.209020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.220064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.221178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.233953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.234030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.234155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.234279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80316) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.234388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.235124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80315) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 17:12:44.252926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.253119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 17:12:44.253360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.253486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.253583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 17:12:44.253896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 17:12:44.254023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.254233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.254383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 17:12:44.254482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.254596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.254684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.254893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.255020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.255203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.255421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.265763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.266033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.266408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.266699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.266845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.267018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.267282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.267562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.274938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.275774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.278177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.278480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.278758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.279043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.279168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.279317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.279403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.279565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.279689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.279826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.279920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.280948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.281202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.282012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.282327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.307760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.309142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.309356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.309635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.310787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.311072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.315036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.315320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.315597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.316865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.317145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.317425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.322964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.323244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.324851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.325132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.327690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.328011 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.328294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.328554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.328846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.329115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.329375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.329640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.330152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.330462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.330739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.331008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.331286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.331555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.331822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.332087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.348706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.348982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.351291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.351568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.353774 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.356091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.357406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.357701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.360226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.360520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.362858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.365743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.366470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.369639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.370428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.370722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.371012 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.371303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.371579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.371862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.373277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.373599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.373885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.374172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.374450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.374762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.390836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.391134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.391402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.391664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.394876 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.395165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.395434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.395703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.399536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.401218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.401486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.403656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.404660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.404952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.405230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.405368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.405483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.405575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.405795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.409438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.409720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.410005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.410302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.410572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.419116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.419394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.419685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.419959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.420255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.420518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.420790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.424389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.424691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.424979 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.425315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.425520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.425815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.426093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.440334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.443618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.445752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.446918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.448521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.449055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.450303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.450842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.451135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.452414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.454578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.456354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.456636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.456926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.458472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.460205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.463453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.463742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.464025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.464149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.464286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.465850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.469662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.469960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.470250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.470552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.473542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.473827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.474105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.479724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.479988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.480298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.481904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80316) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.482160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.482490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.482767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.483040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.483314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.483582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.483828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.484248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.484536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.484803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.485054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.485314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.485576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80316) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.488635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80315) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 17:12:44.488935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.489209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.489474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.489748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.490018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.490316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.490603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.490976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.491253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.491526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.491801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.492430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.492717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80315) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 17:12:44.523803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615312bf9c0 pid: 80316 (default app) Jul 12 17:12:44.527307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e900-61ce-46c0-9514-112f76fb4bfb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:44.527603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e900-61ce-46c0-9514-112f76fb4bfb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:44.527885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1e900-61ce-46c0-9514-112f76fb4bfb None None] PATH_INFO: `/v3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:44.531181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615312bf9c0 pid: 80315 (default app) Jul 12 17:12:44.532365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Tue Jul 12 17:12:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:12:52.185633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869858e-a772-4faf-a7e9-31657e64bb50 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:52.186555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869858e-a772-4faf-a7e9-31657e64bb50 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:52.186555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869858e-a772-4faf-a7e9-31657e64bb50 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:52.193711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:12:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:12:52.199277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:52.199715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:52.199805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:52.268603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: INFO dbcounter [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] Registered counter for database keystone Jul 12 17:12:52.293728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG oslo_db.sqlalchemy.engines [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80316) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:12:52.302131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writer thread running {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:12:52.482335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80316) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 17:12:52.482655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG passlib.handlers.bcrypt [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80316) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 17:12:52.537689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:12:52.539377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:12:52.670811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:12:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 17:12:52.891356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869858e-a772-4faf-a7e9-31657e64bb50 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:52.965344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: INFO dbcounter [None req-c869858e-a772-4faf-a7e9-31657e64bb50 None None] Registered counter for database keystone Jul 12 17:12:52.986516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG oslo_db.sqlalchemy.engines [None req-c869858e-a772-4faf-a7e9-31657e64bb50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80315) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 17:12:52.998049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writer thread running {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 17:12:53.123319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869858e-a772-4faf-a7e9-31657e64bb50 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:53.128904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2179c-6d90-41b9-84d9-2ed0bf3dcb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:53.129581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2179c-6d90-41b9-84d9-2ed0bf3dcb07 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:53.129862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2179c-6d90-41b9-84d9-2ed0bf3dcb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:53.130136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2179c-6d90-41b9-84d9-2ed0bf3dcb07 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:53.139408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2179c-6d90-41b9-84d9-2ed0bf3dcb07 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:53.191650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING keystone.common.rbac_enforcer.enforcer [None req-29e2179c-6d90-41b9-84d9-2ed0bf3dcb07 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 17:12:53.192216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2179c-6d90-41b9-84d9-2ed0bf3dcb07 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:53.204738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Jul 12 17:12:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 17:12:53.211151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:53.227003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7d0f5-96a3-4d6a-92b9-be293699fdfe None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:53.232583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e1136-9683-4898-9775-16ed668f1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:53.233721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e1136-9683-4898-9775-16ed668f1eba admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:53.234015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e1136-9683-4898-9775-16ed668f1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:53.234387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e1136-9683-4898-9775-16ed668f1eba admin admin] PATH_INFO: `/v3/projects/d7ba288325ae4db7b10fd752229e632e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:53.236035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e1136-9683-4898-9775-16ed668f1eba admin admin] RBAC: Authorizing `identity:get_project(project_id=d7ba288325ae4db7b10fd752229e632e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:53.288965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bc4e1136-9683-4898-9775-16ed668f1eba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 17:12:53.289307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e1136-9683-4898-9775-16ed668f1eba admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:53.294203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Tue Jul 12 17:12:53 2022] GET /identity/v3/projects/d7ba288325ae4db7b10fd752229e632e => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:12:55.275256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3344cf-9e95-4aeb-8a59-a4cc9588f4a2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:55.275831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3344cf-9e95-4aeb-8a59-a4cc9588f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:55.275831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3344cf-9e95-4aeb-8a59-a4cc9588f4a2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:55.279915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:12:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:12:55.286208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec3de-5b3e-48f3-ba2f-371df337b012 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:55.286640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec3de-5b3e-48f3-ba2f-371df337b012 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:55.286799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec3de-5b3e-48f3-ba2f-371df337b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:55.309398 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-284ec3de-5b3e-48f3-ba2f-371df337b012 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:12:55.311747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-284ec3de-5b3e-48f3-ba2f-371df337b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:12:55.320871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:12:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 17:12:55.343011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3344cf-9e95-4aeb-8a59-a4cc9588f4a2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:55.357270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3344cf-9e95-4aeb-8a59-a4cc9588f4a2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:55.362255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e51ce6-17c3-40ce-9d4d-665c0d51242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:55.362904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e51ce6-17c3-40ce-9d4d-665c0d51242a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:55.363182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e51ce6-17c3-40ce-9d4d-665c0d51242a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:55.363454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e51ce6-17c3-40ce-9d4d-665c0d51242a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:55.372217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e51ce6-17c3-40ce-9d4d-665c0d51242a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:55.374003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e51ce6-17c3-40ce-9d4d-665c0d51242a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:55.383605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Jul 12 17:12:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:12:55.389613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ec3de-5b3e-48f3-ba2f-371df337b012 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:55.399132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ec3de-5b3e-48f3-ba2f-371df337b012 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:55.404926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7149a-c4db-44ae-bdde-136747eb8cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:55.405810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7149a-c4db-44ae-bdde-136747eb8cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:55.406139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7149a-c4db-44ae-bdde-136747eb8cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:55.406520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7149a-c4db-44ae-bdde-136747eb8cd2 admin admin] PATH_INFO: `/v3/users/8c091920114540d88a55ece0ae3e28cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:55.408097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7149a-c4db-44ae-bdde-136747eb8cd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=8c091920114540d88a55ece0ae3e28cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:55.409953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7149a-c4db-44ae-bdde-136747eb8cd2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:55.411596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Tue Jul 12 17:12:55 2022] GET /identity/v3/users/8c091920114540d88a55ece0ae3e28cf => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:12:57.475970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184f26-3638-4a71-95df-c1a924f0c4c1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:57.476531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184f26-3638-4a71-95df-c1a924f0c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:57.476531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f184f26-3638-4a71-95df-c1a924f0c4c1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:57.477891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:12:57.483326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad6e06-c087-44b3-bd14-242d4ab6b6b6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:57.483744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad6e06-c087-44b3-bd14-242d4ab6b6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:57.484123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad6e06-c087-44b3-bd14-242d4ab6b6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:57.502244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-81ad6e06-c087-44b3-bd14-242d4ab6b6b6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:12:57.503473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-81ad6e06-c087-44b3-bd14-242d4ab6b6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:12:57.535577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a50eb-3471-4f5e-87cd-3c60daad0fe3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:57.535837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a50eb-3471-4f5e-87cd-3c60daad0fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:57.536115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a50eb-3471-4f5e-87cd-3c60daad0fe3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:57.537562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:12:57.542950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:57.543238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:57.543680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:57.585100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80315) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 17:12:57.585525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG passlib.handlers.bcrypt [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80315) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 17:12:57.588259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:12:57.610724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad6e06-c087-44b3-bd14-242d4ab6b6b6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:57.631976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:12:57.633597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:12:57.635545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:12:57.723044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad6e06-c087-44b3-bd14-242d4ab6b6b6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:57.740389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:12:57.760174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:57.760995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:57.761270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:57.761520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:57.763505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:57.773973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:12:57.785297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:12:57.786244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:12:57.787107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:12:57.792657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:57.865393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d368b-21f7-4ef0-bd7a-d49b9c77438a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:57.868029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:12:57.877551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:12:57.896311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6c00-99ea-48f3-a849-1d0d7b584ef9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:57.903917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:57.904931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:57.905272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:57.905607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:57.930476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:57.931188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:57.931472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:57.931748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:57.932503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:12:57.932787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:57.934201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:57.946734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:12:57.952531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:57.973417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:57.974994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:58.068933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7bf9-8134-421b-bed1-292151a54852 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:58.076599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 8/16] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 17:12:58.082652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:58.085430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:12:58.103838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:58.104731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:58.105007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:58.105275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] PATH_INFO: `/v3/users/8c091920114540d88a55ece0ae3e28cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:58.106523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] RBAC: Authorizing `identity:get_user(user_id=8c091920114540d88a55ece0ae3e28cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:58.107995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:58.109823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:12:57 2022] GET /identity/v3/users/8c091920114540d88a55ece0ae3e28cf => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:12:58.115442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:58.130552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:12:58.184768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7cdf-6b36-4785-bb18-bb4b4f17cd95 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:58.213624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5f9d-9873-46e6-91cf-e08fe345a77f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:58.217507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:58.218359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:58.218646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:58.218920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:58.239377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:58.240856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:58.248709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:58.249525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:58.249834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:58.250108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:58.251417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:58.252892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:58.254518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:12:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:12:58.260383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:12:58.261522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:12:58.262361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:12:58.263172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:12:58.263172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:12:58.263172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:12:58.263172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:12:58.263172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:12:58.268714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:12:58.327114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:12:58.341714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:12:58.363320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886380b-6316-47ef-874d-1223ccd17b89 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:58.376661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fd5f3-a97a-4580-9636-c647bf184ad8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:12:58.399358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd181e6-d580-420e-9308-6d68d8bce0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:58.400013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd181e6-d580-420e-9308-6d68d8bce0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:58.400311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd181e6-d580-420e-9308-6d68d8bce0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:58.400581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd181e6-d580-420e-9308-6d68d8bce0e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:58.401415 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd181e6-d580-420e-9308-6d68d8bce0e8 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.domain.id=default, user.id=8c091920114540d88a55ece0ae3e28cf) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:12:58.401722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd181e6-d580-420e-9308-6d68d8bce0e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:58.403186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd181e6-d580-420e-9308-6d68d8bce0e8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:58.410023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1322 bytes} [Tue Jul 12 17:12:58 2022] GET /identity/v3/role_assignments?user.id=8c091920114540d88a55ece0ae3e28cf&scope.domain.id=default&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:12:58.411464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd7a1f-0da0-4b85-9f47-6701fcb765f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:12:58.412142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7a1f-0da0-4b85-9f47-6701fcb765f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:12:58.412431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7a1f-0da0-4b85-9f47-6701fcb765f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:12:58.412712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd7a1f-0da0-4b85-9f47-6701fcb765f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:12:58.413458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd7a1f-0da0-4b85-9f47-6701fcb765f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:12:58.413768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd7a1f-0da0-4b85-9f47-6701fcb765f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:12:58.415231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd7a1f-0da0-4b85-9f47-6701fcb765f3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:12:58.436588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:00.539999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b7e3-dd8a-4ca0-aac9-24dbec6512e5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:00.540984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b7e3-dd8a-4ca0-aac9-24dbec6512e5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:00.541435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080b7e3-dd8a-4ca0-aac9-24dbec6512e5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:00.543320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:00.549681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd934dc-32df-4eac-9e9a-8fb1de18a8d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:00.550594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd934dc-32df-4eac-9e9a-8fb1de18a8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:00.551068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd934dc-32df-4eac-9e9a-8fb1de18a8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:00.575316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8dd934dc-32df-4eac-9e9a-8fb1de18a8d6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:00.576855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8dd934dc-32df-4eac-9e9a-8fb1de18a8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:00.669007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 11/23] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:00.703672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080b7e3-dd8a-4ca0-aac9-24dbec6512e5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:00.843404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080b7e3-dd8a-4ca0-aac9-24dbec6512e5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:00.888069 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931f763-835c-4f0e-8361-6a17accd5eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:00.888890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f763-835c-4f0e-8361-6a17accd5eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:00.889177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f763-835c-4f0e-8361-6a17accd5eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:00.889455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931f763-835c-4f0e-8361-6a17accd5eb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:00.911302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931f763-835c-4f0e-8361-6a17accd5eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6931f763-835c-4f0e-8361-6a17accd5eb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:00.919065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:00.919908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:00.920682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:00.922035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 13/24] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:00.927461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd934dc-32df-4eac-9e9a-8fb1de18a8d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:00.991351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:01.022623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32f81-7cc1-405e-abdd-96ae4fb94a9c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.022931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32f81-7cc1-405e-abdd-96ae4fb94a9c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.023188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32f81-7cc1-405e-abdd-96ae4fb94a9c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.024588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 14/25] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:01.039565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b510af-bcb0-4e1d-bbcc-ff93bfb980f4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.039855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b510af-bcb0-4e1d-bbcc-ff93bfb980f4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.040131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b510af-bcb0-4e1d-bbcc-ff93bfb980f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.048108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:01.070738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-38b510af-bcb0-4e1d-bbcc-ff93bfb980f4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:01.072662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-38b510af-bcb0-4e1d-bbcc-ff93bfb980f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:01.091982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd934dc-32df-4eac-9e9a-8fb1de18a8d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:01.181463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 15/26] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:01.185942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124c208-88a6-44f2-abaf-2812441290ba None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.186242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124c208-88a6-44f2-abaf-2812441290ba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.186554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124c208-88a6-44f2-abaf-2812441290ba None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.188468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:01.188592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 16/27] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:01.189754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.190227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.190758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.191733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:01.192227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:01.194844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:01.201204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbf871-7ce8-40a4-915e-c9a5690ea328 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.201722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbf871-7ce8-40a4-915e-c9a5690ea328 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.202218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbf871-7ce8-40a4-915e-c9a5690ea328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.226781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 12/28] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:01.227990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:01.245619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1dbf871-7ce8-40a4-915e-c9a5690ea328 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:01.247292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1dbf871-7ce8-40a4-915e-c9a5690ea328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:01.381441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 17/29] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:01.386603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbf871-7ce8-40a4-915e-c9a5690ea328 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:01.428337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede863-c98d-43b5-9e70-d55b279724fe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:01.444100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:01.477251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a540e55-d64a-45ac-8076-ac4f5a13fb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:01.478354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a540e55-d64a-45ac-8076-ac4f5a13fb96 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.478861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a540e55-d64a-45ac-8076-ac4f5a13fb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.479329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a540e55-d64a-45ac-8076-ac4f5a13fb96 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.480774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a540e55-d64a-45ac-8076-ac4f5a13fb96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:01.482895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a540e55-d64a-45ac-8076-ac4f5a13fb96 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:01.489945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:01.534950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbf871-7ce8-40a4-915e-c9a5690ea328 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:01.578883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:01.580706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.581205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.581719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] PATH_INFO: `/v3/users/8c091920114540d88a55ece0ae3e28cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.583292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] RBAC: Authorizing `identity:get_user(user_id=8c091920114540d88a55ece0ae3e28cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:01.585307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:01.587196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 18/30] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:01 2022] GET /identity/v3/users/8c091920114540d88a55ece0ae3e28cf => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:01.588220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:01.646148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 13/31] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Jul 12 17:13:01 2022] POST /identity/v3/roles => generated 219 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:01.655121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae4be-0c5a-4c72-b42a-8e0331c00bac None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.655656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae4be-0c5a-4c72-b42a-8e0331c00bac None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.656174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae4be-0c5a-4c72-b42a-8e0331c00bac None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.657715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 14/32] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:01.658632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ae4be-0c5a-4c72-b42a-8e0331c00bac None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:01.700590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2ea67-ef6d-4859-a5a6-fa4175581f3d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:01.739371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:01.749906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e0ba8-0126-4914-904a-f987a9aaa456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:01.750790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0ba8-0126-4914-904a-f987a9aaa456 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.751074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0ba8-0126-4914-904a-f987a9aaa456 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.751346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e0ba8-0126-4914-904a-f987a9aaa456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.778001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e0ba8-0126-4914-904a-f987a9aaa456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:01.779565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e0ba8-0126-4914-904a-f987a9aaa456 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4f6e0ba8-0126-4914-904a-f987a9aaa456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:13:01.824209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:01.825091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:01.825889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:13:01.825889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:13:01.825889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:13:01.825889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:01.825889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 19/33] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:01.836960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62531428-795e-4c4d-9bb0-0a0868dbcd75 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.837302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62531428-795e-4c4d-9bb0-0a0868dbcd75 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.837536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62531428-795e-4c4d-9bb0-0a0868dbcd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.874856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-62531428-795e-4c4d-9bb0-0a0868dbcd75 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:01.876503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-62531428-795e-4c4d-9bb0-0a0868dbcd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:01.884297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ae4be-0c5a-4c72-b42a-8e0331c00bac None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:01.928291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:01.929121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:01.929406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:01.929683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:01.931319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:01.933567 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:01.935947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 15/34] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:01.936991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:01.964932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 20/35] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:01.966173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62531428-795e-4c4d-9bb0-0a0868dbcd75 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:01.978820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:02.076891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de46694-7e3e-4c34-96dc-76eba730aff0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:02.122744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:02.123789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.124278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.124806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.125905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:02.126512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:02.128117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:02.130473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62531428-795e-4c4d-9bb0-0a0868dbcd75 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:02.143586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 16/36] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:02.144721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:02.148003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:02.174558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:02.175725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.176014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.176294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] PATH_INFO: `/v3/domains/default/users/8c091920114540d88a55ece0ae3e28cf/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.178880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8c091920114540d88a55ece0ae3e28cf, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:02.180756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:02.258856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:02.264831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5e8a6-014a-4966-9de7-6981bf892387 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:02.300294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61ea73-d340-42a0-84e6-b7781bf6b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:02.300976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ea73-d340-42a0-84e6-b7781bf6b78e None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.301264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ea73-d340-42a0-84e6-b7781bf6b78e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.301588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61ea73-d340-42a0-84e6-b7781bf6b78e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.302369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ea73-d340-42a0-84e6-b7781bf6b78e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:02.303776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61ea73-d340-42a0-84e6-b7781bf6b78e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:02.322329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 21/37] 10.222.0.50 () {58 vars in 1361 bytes} [Tue Jul 12 17:13:01 2022] PUT /identity/v3/domains/default/users/8c091920114540d88a55ece0ae3e28cf/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:02.322329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:02.325134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 17/38] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Jul 12 17:13:02 2022] POST /identity/v3/roles => generated 225 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:02.326772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c634de6-7434-4cb5-b131-4a6b93d63281 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.327128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c634de6-7434-4cb5-b131-4a6b93d63281 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.327414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c634de6-7434-4cb5-b131-4a6b93d63281 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.329243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 18/39] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:02.335679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace4594-384a-42a5-8a1a-0e6ad2e1d132 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.336055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace4594-384a-42a5-8a1a-0e6ad2e1d132 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.336341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace4594-384a-42a5-8a1a-0e6ad2e1d132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.360369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2ace4594-384a-42a5-8a1a-0e6ad2e1d132 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:02.362136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2ace4594-384a-42a5-8a1a-0e6ad2e1d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:02.454946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 19/40] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:02.456602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3728e13-ce7f-4186-ba9a-65080882d791 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.456896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3728e13-ce7f-4186-ba9a-65080882d791 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.457170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3728e13-ce7f-4186-ba9a-65080882d791 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.458666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 20/41] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:02.465178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436be7f-cc90-4084-834f-624ecd0281fe None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.465466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436be7f-cc90-4084-834f-624ecd0281fe None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.465820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436be7f-cc90-4084-834f-624ecd0281fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.486072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d436be7f-cc90-4084-834f-624ecd0281fe None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:02.487484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d436be7f-cc90-4084-834f-624ecd0281fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:02.582751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 21/42] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:02.583636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436be7f-cc90-4084-834f-624ecd0281fe None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:02.606828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:02.618245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3227-5786-426d-ba45-bdb9154e7629 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:02.655548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:02.656636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.657111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.657572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.659408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:02.661265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:02.699020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 22/43] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:13:02 2022] POST /identity/v3/projects => generated 301 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:02.699870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:02.716548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436be7f-cc90-4084-834f-624ecd0281fe None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:02.767846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:02.769138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.769584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.770491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.772243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:02.774608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:02.776609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 22/44] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:02.782645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:02.783465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:02.851687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164a8cb-402f-48ae-a857-f955316f8fab None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:02.895168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d50005-0107-4a7c-8b76-cf72b3cb5da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:02.895871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d50005-0107-4a7c-8b76-cf72b3cb5da7 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.896163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d50005-0107-4a7c-8b76-cf72b3cb5da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.896443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d50005-0107-4a7c-8b76-cf72b3cb5da7 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.897217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d50005-0107-4a7c-8b76-cf72b3cb5da7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:02.897938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:02.899330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d50005-0107-4a7c-8b76-cf72b3cb5da7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:02.917665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Jul 12 17:13:02 2022] POST /identity/v3/roles => generated 223 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:02.921622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f58a3-4fbd-41ed-9634-c17af5516ed7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:02.967136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db5e38-2e64-4106-91ae-01b382af0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:02.967841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5e38-2e64-4106-91ae-01b382af0652 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:02.968123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5e38-2e64-4106-91ae-01b382af0652 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:02.968476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db5e38-2e64-4106-91ae-01b382af0652 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:02.969248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db5e38-2e64-4106-91ae-01b382af0652 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:02.970793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db5e38-2e64-4106-91ae-01b382af0652 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:03.001797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:13:02 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:04.468093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510a85f-9ea7-4dd7-97b7-cf106f633973 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:04.468911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510a85f-9ea7-4dd7-97b7-cf106f633973 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:04.468911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510a85f-9ea7-4dd7-97b7-cf106f633973 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:04.470376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 24/47] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:04.475459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86423983-0bb3-45ee-84ea-656157d29ab6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:04.475866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86423983-0bb3-45ee-84ea-656157d29ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:04.476026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86423983-0bb3-45ee-84ea-656157d29ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:04.494561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-86423983-0bb3-45ee-84ea-656157d29ab6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:04.495766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-86423983-0bb3-45ee-84ea-656157d29ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:04.568332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 24/48] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:04.593711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510a85f-9ea7-4dd7-97b7-cf106f633973 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:04.685234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:04.702259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510a85f-9ea7-4dd7-97b7-cf106f633973 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:04.737777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:04.738539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:04.738825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:04.739096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:04.749879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:04.757599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:04.758500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:04.759336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 25/49] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:04.766545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86423983-0bb3-45ee-84ea-656157d29ab6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:04.838711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:04.874874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86423983-0bb3-45ee-84ea-656157d29ab6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:04.910105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841023ad-509a-43c4-8717-fa99d61977e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:04.910828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841023ad-509a-43c4-8717-fa99d61977e5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:04.911114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841023ad-509a-43c4-8717-fa99d61977e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:04.911386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841023ad-509a-43c4-8717-fa99d61977e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:04.912159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841023ad-509a-43c4-8717-fa99d61977e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:04.912468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841023ad-509a-43c4-8717-fa99d61977e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:04.913877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841023ad-509a-43c4-8717-fa99d61977e5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:04.923195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 25/50] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:04.928990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:05.014696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22694bb-73bb-4762-993a-bc0982817c63 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:05.014908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22694bb-73bb-4762-993a-bc0982817c63 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:05.015217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22694bb-73bb-4762-993a-bc0982817c63 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:05.016777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 26/51] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:05.021742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ac9bd-cde0-4f4a-a525-d60475fad8fb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:05.022031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ac9bd-cde0-4f4a-a525-d60475fad8fb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:05.022344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ac9bd-cde0-4f4a-a525-d60475fad8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:05.031841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f524-a589-4f7a-928c-1fe36a8c2f9e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:05.040478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b72ac9bd-cde0-4f4a-a525-d60475fad8fb None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:05.041696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b72ac9bd-cde0-4f4a-a525-d60475fad8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:05.066504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:05.067402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:05.067685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:05.067960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] PATH_INFO: `/v3/users/8c091920114540d88a55ece0ae3e28cf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:05.069255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] RBAC: Authorizing `identity:get_user(user_id=8c091920114540d88a55ece0ae3e28cf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:05.070789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:05.072458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 26/52] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:04 2022] GET /identity/v3/users/8c091920114540d88a55ece0ae3e28cf => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:05.078709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:05.095988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:05.200212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b73448-b58e-4710-be22-1b2f1d490461 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:05.229611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 27/53] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:05.236871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:05.237692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:05.237980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:05.238231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:05.239468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:05.240956 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:05.243016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 27/54] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:05.248828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ac9bd-cde0-4f4a-a525-d60475fad8fb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:05.252652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:05.311634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:05.344201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:05.357172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ac9bd-cde0-4f4a-a525-d60475fad8fb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:05.363691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a7132-7c7f-4321-b683-f1dbea65c726 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:05.391419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3c215-3478-44cd-8536-6f4bd6f91fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:05.392190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c215-3478-44cd-8536-6f4bd6f91fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:05.392541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c215-3478-44cd-8536-6f4bd6f91fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:05.392896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3c215-3478-44cd-8536-6f4bd6f91fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:05.393755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3c215-3478-44cd-8536-6f4bd6f91fd6 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.domain.id=default, user.id=8c091920114540d88a55ece0ae3e28cf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:05.394070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3c215-3478-44cd-8536-6f4bd6f91fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:05.395594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3c215-3478-44cd-8536-6f4bd6f91fd6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:05.397460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:05.398277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:05.398591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:05.398868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:05.400048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:05.401516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:05.403199 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:05.404800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 28/56] 10.222.0.50 () {56 vars in 1322 bytes} [Tue Jul 12 17:13:05 2022] GET /identity/v3/role_assignments?user.id=8c091920114540d88a55ece0ae3e28cf&scope.domain.id=default&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:05.411631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:05.528295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db07b4f-a085-4f48-a7ad-0c569d5cd191 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:05.567018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca426d4-650a-41a7-8fee-256b902d0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:05.567622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca426d4-650a-41a7-8fee-256b902d0faf None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:05.567901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca426d4-650a-41a7-8fee-256b902d0faf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:05.568160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca426d4-650a-41a7-8fee-256b902d0faf None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:05.568872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca426d4-650a-41a7-8fee-256b902d0faf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:05.570420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca426d4-650a-41a7-8fee-256b902d0faf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:05.604190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 29/57] 10.222.0.50 () {60 vars in 1140 bytes} [Tue Jul 12 17:13:05 2022] POST /identity/v3/projects => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:07.610021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1648-7e34-4810-bb24-3514cfe6c285 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:07.610745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1648-7e34-4810-bb24-3514cfe6c285 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:07.611185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a1648-7e34-4810-bb24-3514cfe6c285 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:07.613226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 29/58] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:07.618803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc712d3-7e6e-48dc-bd68-3fb3c06245b2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:07.619210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc712d3-7e6e-48dc-bd68-3fb3c06245b2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:07.619369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc712d3-7e6e-48dc-bd68-3fb3c06245b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:07.625075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:07.639466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1cc712d3-7e6e-48dc-bd68-3fb3c06245b2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:07.641093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1cc712d3-7e6e-48dc-bd68-3fb3c06245b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:07.712020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 30/59] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:07.737042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1648-7e34-4810-bb24-3514cfe6c285 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:07.849411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a1648-7e34-4810-bb24-3514cfe6c285 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:07.876797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:07.890750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73557f-accc-4a90-84d8-1b73b4a9bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:07.891553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73557f-accc-4a90-84d8-1b73b4a9bc21 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:07.891845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73557f-accc-4a90-84d8-1b73b4a9bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:07.892123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73557f-accc-4a90-84d8-1b73b4a9bc21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:07.893438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73557f-accc-4a90-84d8-1b73b4a9bc21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:07.894959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73557f-accc-4a90-84d8-1b73b4a9bc21 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:07.896875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 30/60] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:07.905783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc712d3-7e6e-48dc-bd68-3fb3c06245b2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:08.010825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc712d3-7e6e-48dc-bd68-3fb3c06245b2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:08.041001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:08.048316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978af92-db71-4169-acdc-b86f2037126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:08.048995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978af92-db71-4169-acdc-b86f2037126c None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:08.049282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978af92-db71-4169-acdc-b86f2037126c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:08.049549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978af92-db71-4169-acdc-b86f2037126c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:08.050263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978af92-db71-4169-acdc-b86f2037126c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:08.051764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978af92-db71-4169-acdc-b86f2037126c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:08.079479 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 31/61] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:13:07 2022] POST /identity/v3/users => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:11.145683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca31c-ed41-4600-a3e0-f3f0f27fa046 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.146766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca31c-ed41-4600-a3e0-f3f0f27fa046 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.147253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ca31c-ed41-4600-a3e0-f3f0f27fa046 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.148867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 31/62] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:11.154055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d3fdf-5859-4281-9c89-45955d782011 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.154871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d3fdf-5859-4281-9c89-45955d782011 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.155386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d3fdf-5859-4281-9c89-45955d782011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.181782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-856d3fdf-5859-4281-9c89-45955d782011 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:11.183377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-856d3fdf-5859-4281-9c89-45955d782011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:11.276687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 32/63] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:11.319023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca31c-ed41-4600-a3e0-f3f0f27fa046 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:11.364739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5d68e-b9a6-4c54-8429-4ca181b74a0c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.365384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5d68e-b9a6-4c54-8429-4ca181b74a0c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.365863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5d68e-b9a6-4c54-8429-4ca181b74a0c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.367843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 33/64] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:11.375813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11984-a96b-440f-9369-45d2e8761095 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.376419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11984-a96b-440f-9369-45d2e8761095 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.376887 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11984-a96b-440f-9369-45d2e8761095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.409637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e8e11984-a96b-440f-9369-45d2e8761095 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:11.411383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e8e11984-a96b-440f-9369-45d2e8761095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:11.509167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ca31c-ed41-4600-a3e0-f3f0f27fa046 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:11.550555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 34/65] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:11.570251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11984-a96b-440f-9369-45d2e8761095 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:11.583612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:11.584451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.584735 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.585010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.610489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:11.628991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:11.630087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:11.631167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:11.633538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 32/66] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:11.638086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:11.639847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:11.697537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11984-a96b-440f-9369-45d2e8761095 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:11.735973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008abd-8d65-4f34-ab7e-a529004ea24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:11.736912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008abd-8d65-4f34-ab7e-a529004ea24e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.737202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008abd-8d65-4f34-ab7e-a529004ea24e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.737480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008abd-8d65-4f34-ab7e-a529004ea24e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.750448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53008abd-8d65-4f34-ab7e-a529004ea24e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:11.751498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-53008abd-8d65-4f34-ab7e-a529004ea24e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:11.758937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:11.759840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:11.760785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 35/67] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:11.761570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c392aaa-6baa-4f7e-a78d-69b19f3c2abc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.761892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c392aaa-6baa-4f7e-a78d-69b19f3c2abc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.766578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c392aaa-6baa-4f7e-a78d-69b19f3c2abc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.768276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 36/68] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:11.770567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c392aaa-6baa-4f7e-a78d-69b19f3c2abc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:11.807849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee525a8-d50a-40b1-bc71-13b5b9bd71c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:11.845197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870fbae-aefa-4e0b-9e64-064c9c5f6c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:11.845993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870fbae-aefa-4e0b-9e64-064c9c5f6c56 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.846383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870fbae-aefa-4e0b-9e64-064c9c5f6c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.846673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870fbae-aefa-4e0b-9e64-064c9c5f6c56 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.847447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870fbae-aefa-4e0b-9e64-064c9c5f6c56 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:11.847753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870fbae-aefa-4e0b-9e64-064c9c5f6c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:11.849174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870fbae-aefa-4e0b-9e64-064c9c5f6c56 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:11.862468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 33/69] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:11.862468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f438cb-df74-4403-a960-94eb39b145df None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.862468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f438cb-df74-4403-a960-94eb39b145df None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.862468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f438cb-df74-4403-a960-94eb39b145df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.878976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-28f438cb-df74-4403-a960-94eb39b145df None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:11.880199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-28f438cb-df74-4403-a960-94eb39b145df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:11.884435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c392aaa-6baa-4f7e-a78d-69b19f3c2abc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:11.894526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:11.922940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd74958-607a-4f1a-afef-74db81d00c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:11.923638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd74958-607a-4f1a-afef-74db81d00c2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.923927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd74958-607a-4f1a-afef-74db81d00c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.924209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd74958-607a-4f1a-afef-74db81d00c2e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.925196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd74958-607a-4f1a-afef-74db81d00c2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:11.925295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd74958-607a-4f1a-afef-74db81d00c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:11.926899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd74958-607a-4f1a-afef-74db81d00c2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:11.936008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 37/70] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:11.943041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dbaf8-99fd-4329-a904-e628c9f18512 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:11.943191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dbaf8-99fd-4329-a904-e628c9f18512 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:11.943376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2dbaf8-99fd-4329-a904-e628c9f18512 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:11.946340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 38/71] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:11.946340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dbaf8-99fd-4329-a904-e628c9f18512 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:11.954578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 34/72] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:11.955658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f438cb-df74-4403-a960-94eb39b145df None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.001215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.064414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f438cb-df74-4403-a960-94eb39b145df None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.066051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2dbaf8-99fd-4329-a904-e628c9f18512 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.098732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7183e-12af-44df-8457-d873c5bc7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.099622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7183e-12af-44df-8457-d873c5bc7e73 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.099908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7183e-12af-44df-8457-d873c5bc7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.100183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7183e-12af-44df-8457-d873c5bc7e73 None admin] PATH_INFO: `/v3/users/8c091920114540d88a55ece0ae3e28cf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.101618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7183e-12af-44df-8457-d873c5bc7e73 None admin] RBAC: Authorizing `identity:get_user(user_id=8c091920114540d88a55ece0ae3e28cf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:12.102239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.103118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7183e-12af-44df-8457-d873c5bc7e73 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:12.103211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.103448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.103726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.104778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 35/73] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:11 2022] GET /identity/v3/users/8c091920114540d88a55ece0ae3e28cf => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:12.104778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74ec7-d05f-4554-8555-27ab813e1489 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.104778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74ec7-d05f-4554-8555-27ab813e1489 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.104778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74ec7-d05f-4554-8555-27ab813e1489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.122514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ecd74ec7-d05f-4554-8555-27ab813e1489 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:12.122646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:12.123692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ecd74ec7-d05f-4554-8555-27ab813e1489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:12.124054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:12.125846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 39/74] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:11 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:12.126621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.153947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.191115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 36/75] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:12.192478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4060111-7efd-477e-bf2e-3c41588a492b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.192765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4060111-7efd-477e-bf2e-3c41588a492b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.193041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4060111-7efd-477e-bf2e-3c41588a492b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.194525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 37/76] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:12.195038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4060111-7efd-477e-bf2e-3c41588a492b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.232798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653c067-82ee-4a7e-ae02-18cb25d609d9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.252780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.267172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.267985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.268271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.268548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.278540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:12.286325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:12.287177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 40/77] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:12.293079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.313624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4060111-7efd-477e-bf2e-3c41588a492b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.347732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847752c-f365-4517-b4da-85f7253891ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.348402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847752c-f365-4517-b4da-85f7253891ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.348690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847752c-f365-4517-b4da-85f7253891ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.348973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847752c-f365-4517-b4da-85f7253891ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.379313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.391620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06827b59-00ab-4fbb-b7b1-d2f91f3ca30a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.419226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847752c-f365-4517-b4da-85f7253891ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:12.420872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847752c-f365-4517-b4da-85f7253891ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:12.425384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.426045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.426365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.426649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.460468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.493323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:12.494768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:12.518476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 38/78] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:12.519768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31da89-82bb-404d-b372-1b41998d5d7e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.520232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31da89-82bb-404d-b372-1b41998d5d7e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.520652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31da89-82bb-404d-b372-1b41998d5d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.536848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3d31da89-82bb-404d-b372-1b41998d5d7e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:12.538047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d31da89-82bb-404d-b372-1b41998d5d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:12.585062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.599334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 41/79] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:12.600198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.611794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 39/80] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:12.612646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31da89-82bb-404d-b372-1b41998d5d7e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.681684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.701950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807f489-1269-4c9f-bb6b-f935c2b23a09 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.712477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31da89-82bb-404d-b372-1b41998d5d7e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.736296 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.737128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.737413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.737688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.746771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.747394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.747684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.747857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:12.747948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.748721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:12.749030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:12.750667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:12.756008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:12.756827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:12.757584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 42/81] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:12.758193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.763082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 40/82] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:12.763082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.811583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.860492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ae944-7b02-4581-9d1c-cea57b9bd636 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.863528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359ade5-e822-47ad-beff-0a4914b3542c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:12.890076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:12.896188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.896878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:12.897073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.897358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.897638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.897755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:12.898042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:12.898345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:12.898902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:12.899545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:12.900362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:12.901015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:12.902074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 41/83] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:12.902900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:12.906277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 43/84] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:12.907303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.007021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117c41-6967-447b-9dbc-b7bb63305319 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.011840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec6b69-f677-459b-91a1-1ee5c46d9d6c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.027892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:13.040801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.041607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.041897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.042179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.043378 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.044832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.046755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 42/85] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:13.046888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.047328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.047445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.047597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.047894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.048655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:13.048963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.050349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.058872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 44/86] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:13.059679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.118509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:13.152324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78d53f-f57b-4270-a136-cb8fd21f5e2c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.161704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906caaf-dafe-45da-acf0-ea259034c2ea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.186135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.187079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.187348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.187626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.188894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.190396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.192040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 43/87] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:13 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:13.195191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.196101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.196776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.197064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.197343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.198196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=641b5e5c724f4458b0f4a4af57df9509) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:13.198549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.200007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.206032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 45/88] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:13 2022] GET /identity/v3/role_assignments?user.id=641b5e5c724f4458b0f4a4af57df9509&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:13.211903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.271609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:13.305319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521a150-d74a-493e-8f72-fddfee3c9f80 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.339148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125748c4-502b-4a4d-9b3a-d87c7ccc2e49 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.340987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.341675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.341956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.342232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.343150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=8c091920114540d88a55ece0ae3e28cf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:13.343459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.344960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.348927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:13.358545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 44/89] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:13 2022] GET /identity/v3/role_assignments?user.id=8c091920114540d88a55ece0ae3e28cf&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:13.358545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.393549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.394258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.394579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.394864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.395611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.397113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.430319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 46/90] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:13:13 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:13.430319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.541246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e5b53-d77a-4282-8b71-a9e7954e5db5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.551050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:13.556044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8abd9-12dc-4ced-8d1b-d0cde67534b2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.583909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.585122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.585598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.586041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.587475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.589146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.591042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 45/91] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:13 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:13.601731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.606851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.607807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.608985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.609982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.736480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.738310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.738847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:13.780067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b84c1c-1100-4b06-80ca-fcb50ca94adc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:13.826021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:13.827708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:13.828701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:13.828990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:13.868786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:13.876443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 47/92] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:13.882993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:13.925891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:13.927452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:13.993495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:14.009392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28606d7e-12ee-4c1c-9723-0899ff53cedf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:14.032177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 46/93] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:14.043565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:14.050068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:14.051002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:14.051293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:14.051565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] PATH_INFO: `/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:14.054723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] RBAC: Authorizing `identity:get_project(project_id=5ba987b5969d4cc8988cf7f8343da6c6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:14.060145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:14.062807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 48/94] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:13 2022] GET /identity/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:14.077950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:14.163229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83b48d-fc7a-4346-9ced-91912ba3b874 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:14.168588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:14.210734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:14.211929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:14.212355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:14.212635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:14.213981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:14.216227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:14.217957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 47/95] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:14 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:14.218320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58d4a-341d-4ecd-8d9c-fa90ceb9d363 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:14.227327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:14.257466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709adf49-995d-4cd8-82f5-f0f69410945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:14.258561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709adf49-995d-4cd8-82f5-f0f69410945b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:14.259015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709adf49-995d-4cd8-82f5-f0f69410945b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:14.259500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709adf49-995d-4cd8-82f5-f0f69410945b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:14.260529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709adf49-995d-4cd8-82f5-f0f69410945b None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=5ba987b5969d4cc8988cf7f8343da6c6, user.id=641b5e5c724f4458b0f4a4af57df9509) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:14.261037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709adf49-995d-4cd8-82f5-f0f69410945b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:14.262782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709adf49-995d-4cd8-82f5-f0f69410945b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:14.266053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:14.269917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 49/96] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:14 2022] GET /identity/v3/role_assignments?user.id=641b5e5c724f4458b0f4a4af57df9509&scope.project.id=5ba987b5969d4cc8988cf7f8343da6c6&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:14.351790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd8d4a-be1f-4694-8e4a-e0b73d66f4bb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:14.396215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899cbf-1b8d-400a-9595-b53e60763fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:14.396904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899cbf-1b8d-400a-9595-b53e60763fbd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:14.397193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899cbf-1b8d-400a-9595-b53e60763fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:14.397475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899cbf-1b8d-400a-9595-b53e60763fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:14.402422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899cbf-1b8d-400a-9595-b53e60763fbd None admin] RBAC: Adding query filter params (role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=641b5e5c724f4458b0f4a4af57df9509) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:14.402870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899cbf-1b8d-400a-9595-b53e60763fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:14.404432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899cbf-1b8d-400a-9595-b53e60763fbd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:14.411409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 48/97] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:14 2022] GET /identity/v3/role_assignments?user.id=641b5e5c724f4458b0f4a4af57df9509&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=e2809f949125439eb6f73ac31122b973 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:15.967618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eb718-9c80-4e63-bdce-5ee269fdde49 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:15.968168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eb718-9c80-4e63-bdce-5ee269fdde49 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:15.968246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2eb718-9c80-4e63-bdce-5ee269fdde49 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:15.969855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 50/98] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:15.984351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863cae-85c8-494e-bc2e-69235ee71959 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:15.984910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863cae-85c8-494e-bc2e-69235ee71959 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:15.984910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13863cae-85c8-494e-bc2e-69235ee71959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.007945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-13863cae-85c8-494e-bc2e-69235ee71959 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:16.009121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13863cae-85c8-494e-bc2e-69235ee71959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:16.059365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209857a-02ab-4183-b21c-1ddb873435dd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.059692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209857a-02ab-4183-b21c-1ddb873435dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.059929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209857a-02ab-4183-b21c-1ddb873435dd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.061321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 51/99] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:16.078387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddced74-faa0-4aab-9bcb-32f643254aa2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.078719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddced74-faa0-4aab-9bcb-32f643254aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.078985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddced74-faa0-4aab-9bcb-32f643254aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.096559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7ddced74-faa0-4aab-9bcb-32f643254aa2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:16.097765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7ddced74-faa0-4aab-9bcb-32f643254aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:16.131831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 49/100] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:16.192647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863cae-85c8-494e-bc2e-69235ee71959 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:16.193290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 52/101] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:16.217953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddced74-faa0-4aab-9bcb-32f643254aa2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:16.261622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:16.291687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:16.323590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddced74-faa0-4aab-9bcb-32f643254aa2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:16.360125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:16.361221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.361661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.362068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.373605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:16.382465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:16.383501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:16.384453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:16.386653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 53/102] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:16.392839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:16.472688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13863cae-85c8-494e-bc2e-69235ee71959 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:16.500487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde13bae-fb8c-49e2-8cbb-e3971562a7c2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:16.529141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:16.529967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.530255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.530664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.535211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:16.543685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:16.550603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:16.551290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.551573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.551848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:16.552655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:16.553658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:16.554591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:16.555162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:16.555162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:16.555162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:16.556844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 50/103] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:16.566737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 54/104] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:16.574037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:16.574646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:16.679392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c110-0f09-453e-bbbe-7d567ba00d3d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:16.713901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f71f48-5438-4131-99fd-99e84c552fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:16.714696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71f48-5438-4131-99fd-99e84c552fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.715292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71f48-5438-4131-99fd-99e84c552fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.715580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71f48-5438-4131-99fd-99e84c552fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.716344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f71f48-5438-4131-99fd-99e84c552fe9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:16.716659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f71f48-5438-4131-99fd-99e84c552fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:16.718154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f71f48-5438-4131-99fd-99e84c552fe9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:16.729470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 55/105] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:16.733051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c73ae-be79-4fab-866b-af74637d7cdb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.733347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c73ae-be79-4fab-866b-af74637d7cdb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.733779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c73ae-be79-4fab-866b-af74637d7cdb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.735375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 56/106] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:16.736613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c73ae-be79-4fab-866b-af74637d7cdb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:16.761907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:16.782388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17618f8-3657-42a2-8f43-9ef6116c0832 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:16.794786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:16.847605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac37c5-354a-45bb-b376-84169bbb6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:16.848513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac37c5-354a-45bb-b376-84169bbb6cdd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.848799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac37c5-354a-45bb-b376-84169bbb6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.849102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac37c5-354a-45bb-b376-84169bbb6cdd None admin] PATH_INFO: `/v3/users/8c091920114540d88a55ece0ae3e28cf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.853808 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c73ae-be79-4fab-866b-af74637d7cdb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:16.855025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac37c5-354a-45bb-b376-84169bbb6cdd None admin] RBAC: Authorizing `identity:get_user(user_id=8c091920114540d88a55ece0ae3e28cf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:16.856518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac37c5-354a-45bb-b376-84169bbb6cdd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:16.858394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 51/107] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:16 2022] GET /identity/v3/users/8c091920114540d88a55ece0ae3e28cf => generated 247 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:16.859965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a6f4-833c-49ad-9f52-36698b0e240d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.860255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a6f4-833c-49ad-9f52-36698b0e240d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.860535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a6f4-833c-49ad-9f52-36698b0e240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.892158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4de3a6f4-833c-49ad-9f52-36698b0e240d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:16.893392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4de3a6f4-833c-49ad-9f52-36698b0e240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:16.902484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:16.903540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:16.903834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:16.904118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:16.910443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:16.911990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:16.916051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 57/108] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:16 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:16.916941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.040186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 52/109] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:17.041059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3a6f4-833c-49ad-9f52-36698b0e240d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.087537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54094aa8-adb1-4530-bd1e-34fa5dfb764d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:17.114683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:17.136465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:17.137357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.137643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.137919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.139336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:17.143113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:17.145072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 58/110] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:16 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:17.148173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.212047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:17.224833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3a6f4-833c-49ad-9f52-36698b0e240d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:17.259950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:17.260889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.261117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.261393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.262637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:17.264108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:17.266168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 53/111] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:17 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:17.271688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.276078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f495ee7-9d8a-42c6-8eaf-0270696c7a39 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:17.316024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5961dd6-1d72-41d7-92a0-f2de9fb2e3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:17.317310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961dd6-1d72-41d7-92a0-f2de9fb2e3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.317794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961dd6-1d72-41d7-92a0-f2de9fb2e3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.318326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5961dd6-1d72-41d7-92a0-f2de9fb2e3e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.331049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5961dd6-1d72-41d7-92a0-f2de9fb2e3e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e5961dd6-1d72-41d7-92a0-f2de9fb2e3e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:17.339851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:17.340715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:17.341471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:17.344634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 59/112] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:17.346262 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5385e-e2fb-49a4-bc35-2361fa8b08c0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.346774 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5385e-e2fb-49a4-bc35-2361fa8b08c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.347263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5385e-e2fb-49a4-bc35-2361fa8b08c0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.349265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 60/113] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:17.350276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5385e-e2fb-49a4-bc35-2361fa8b08c0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.375714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f70a9-5d0e-4d59-9585-94bdd798805b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:17.401446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:17.422462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:17.423383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.423677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.423950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578/users/8c091920114540d88a55ece0ae3e28cf/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.425976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] RBAC: Authorizing `identity:create_grant(project_id=6633d5e6015843a5a5c6444f58897578, user_id=8c091920114540d88a55ece0ae3e28cf, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:17.427495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:17.446342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 54/114] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:17 2022] PUT /identity/v3/projects/6633d5e6015843a5a5c6444f58897578/users/8c091920114540d88a55ece0ae3e28cf/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:17.446342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.473216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:17.498997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5385e-e2fb-49a4-bc35-2361fa8b08c0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:17.551662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e87459-c051-4bca-b463-9fbb029ca271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:17.552873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87459-c051-4bca-b463-9fbb029ca271 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.553163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87459-c051-4bca-b463-9fbb029ca271 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.553586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e87459-c051-4bca-b463-9fbb029ca271 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578/users/641b5e5c724f4458b0f4a4af57df9509/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.556195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e87459-c051-4bca-b463-9fbb029ca271 None admin] RBAC: Authorizing `identity:create_grant(project_id=6633d5e6015843a5a5c6444f58897578, user_id=641b5e5c724f4458b0f4a4af57df9509, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:17.557696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e87459-c051-4bca-b463-9fbb029ca271 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:17.577130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 61/115] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:17 2022] PUT /identity/v3/projects/6633d5e6015843a5a5c6444f58897578/users/641b5e5c724f4458b0f4a4af57df9509/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:17.577130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bf082-0659-4ed7-8461-3c0eb04cf177 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.577130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bf082-0659-4ed7-8461-3c0eb04cf177 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.577537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bf082-0659-4ed7-8461-3c0eb04cf177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.587618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c841146-5668-4550-94b9-c6919cafb048 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:17.597867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b51bf082-0659-4ed7-8461-3c0eb04cf177 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:17.599297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b51bf082-0659-4ed7-8461-3c0eb04cf177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:17.646690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7294-7df7-4d7c-b7a1-02da63db7ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:17.647768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7294-7df7-4d7c-b7a1-02da63db7ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.648249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7294-7df7-4d7c-b7a1-02da63db7ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.648739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7294-7df7-4d7c-b7a1-02da63db7ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.649747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7294-7df7-4d7c-b7a1-02da63db7ea2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:17.650136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7294-7df7-4d7c-b7a1-02da63db7ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:17.651753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7294-7df7-4d7c-b7a1-02da63db7ea2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:17.662510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 55/116] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:17.663907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd837-eec6-4ee5-ad5e-25de5d9b9fa9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.664202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd837-eec6-4ee5-ad5e-25de5d9b9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.664484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fd837-eec6-4ee5-ad5e-25de5d9b9fa9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.665987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 56/117] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:17.667089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfc1ad-e56d-49d7-ab41-86197aaa5c6f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.667431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfc1ad-e56d-49d7-ab41-86197aaa5c6f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.667717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfc1ad-e56d-49d7-ab41-86197aaa5c6f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.669036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 57/118] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:17.674045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd58521-bb7a-4b18-8d82-2335ba021213 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.674447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd58521-bb7a-4b18-8d82-2335ba021213 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.674663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd58521-bb7a-4b18-8d82-2335ba021213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.695768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 62/119] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:17.697152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bf082-0659-4ed7-8461-3c0eb04cf177 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.699480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bbd58521-bb7a-4b18-8d82-2335ba021213 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:17.701144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bbd58521-bb7a-4b18-8d82-2335ba021213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:17.742786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:17.788608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 58/120] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:17.790243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44724b4-6c99-4c3c-8a3f-c601c99ff790 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.790631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44724b4-6c99-4c3c-8a3f-c601c99ff790 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.790924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44724b4-6c99-4c3c-8a3f-c601c99ff790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.811491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d44724b4-6c99-4c3c-8a3f-c601c99ff790 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:17.813536 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d44724b4-6c99-4c3c-8a3f-c601c99ff790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:17.815877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:17.840287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bf082-0659-4ed7-8461-3c0eb04cf177 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:17.881269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:17.882270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:17.882587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:17.882867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] PATH_INFO: `/v3/users/d3500a906a204603aefa2c22ce836f2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:17.894107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 59/121] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:17.895038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44724b4-6c99-4c3c-8a3f-c601c99ff790 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:17.902019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] RBAC: Authorizing `identity:get_user(user_id=d3500a906a204603aefa2c22ce836f2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:17.907846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:17.909667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 63/122] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:17 2022] GET /identity/v3/users/d3500a906a204603aefa2c22ce836f2c => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:17.910608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.006194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44724b4-6c99-4c3c-8a3f-c601c99ff790 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.017244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:18.029814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64183fb9-8d4f-4277-b459-e462d781b03a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.043828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353655c-0561-4068-83ec-89348ded69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.044773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353655c-0561-4068-83ec-89348ded69de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.045114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353655c-0561-4068-83ec-89348ded69de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.045385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3353655c-0561-4068-83ec-89348ded69de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.052800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:18.057748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3353655c-0561-4068-83ec-89348ded69de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:18.065729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.066577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.066872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.067160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.068331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3353655c-0561-4068-83ec-89348ded69de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:18.068682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:18.069723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:18.070710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:18.071343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:18.071690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 64/123] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:18.076093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.077837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 60/124] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:18.078874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353655c-0561-4068-83ec-89348ded69de None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.193820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035095f-290f-409b-aea4-a45040fc9a86 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.214806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3353655c-0561-4068-83ec-89348ded69de None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.234726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.235640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.236031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.236547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.256504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.257725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.258167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.258882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.269214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:18.275178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:18.285334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:18.286209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:18.287086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 61/125] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:18.287712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.326246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:18.328297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:18.355244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:18.411252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811105b-de8d-40f8-8c1a-36985b103a35 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.450986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 65/126] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:18.452023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.457756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.458711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.459206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.459673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.460574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:18.462674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:18.506396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 62/127] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:13:18 2022] POST /identity/v3/projects => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:18.510311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.547628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:18.669779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698987b-2568-4c3c-936d-4f778db2fd59 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.672891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42bce5-c5d7-4b03-ba29-3f1a35a0392f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.685431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:18.729103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.730128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.730652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.731124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.731500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.732258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.732509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:18.732610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.732823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.733291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:18.733630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:18.734271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:18.735633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:18.736138 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:18.746410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 63/128] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:18.746755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 66/129] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:18.747800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.753595 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.883741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c818b-d170-4daf-b5ce-aab729d16a53 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.889724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c6287-ca07-44a2-abae-40759e8f4a0a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:18.903611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:18.924145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.925050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.925335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.925602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.926835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:18.928279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:18.928445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:18.929163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:18.929452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:18.929733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:18.930274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 67/130] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:18.931082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.931348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:18.933621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:18.935611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 64/131] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:18.937076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:18.988902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:19.043596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebacce55-f0a2-446b-a075-5c31c527c7db None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:19.048630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6957a-b801-452d-9dbe-b58ce0263fc5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:19.078338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:19.079240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:19.079552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:19.079797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:19.081013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:19.082499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:19.084065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:19.084461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 68/132] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:19.085246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:19.085455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:19.085887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:19.086331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] PATH_INFO: `/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:19.087689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] RBAC: Authorizing `identity:get_project(project_id=5ba987b5969d4cc8988cf7f8343da6c6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:19.089299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:19.091258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 65/133] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:18 2022] GET /identity/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:19.092305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:19.151610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:19.195649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0579df5-1032-4b50-a787-e464d45ae574 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:19.199353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc191e3d-4991-4643-86c6-d879ceee9e2e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:19.214089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:19.233806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:19.235421 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:19.235975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:19.236087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:19.236378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:19.236660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:19.236990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:19.237461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:19.237575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] RBAC: Adding query filter params (role.id=87bf93c8ec484d3595c777a437c6659b, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=d3500a906a204603aefa2c22ce836f2c) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:19.237818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:19.239388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:19.239626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:19.241363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:19.250337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 66/134] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:19 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:19.250525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 69/135] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:19 2022] GET /identity/v3/role_assignments?user.id=d3500a906a204603aefa2c22ce836f2c&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=87bf93c8ec484d3595c777a437c6659b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:19.250525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:19.275897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:19.359609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf470-8b5d-41dc-9285-415b6cf4f5af None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:19.378630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:19.399766 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116596-9bcb-49dc-a15a-7058d15169f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:19.400691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116596-9bcb-49dc-a15a-7058d15169f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:19.400972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116596-9bcb-49dc-a15a-7058d15169f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:19.401250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116596-9bcb-49dc-a15a-7058d15169f5 None admin] PATH_INFO: `/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6/users/641b5e5c724f4458b0f4a4af57df9509/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:19.403343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116596-9bcb-49dc-a15a-7058d15169f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ba987b5969d4cc8988cf7f8343da6c6, user_id=641b5e5c724f4458b0f4a4af57df9509, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:19.405307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116596-9bcb-49dc-a15a-7058d15169f5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:19.429703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 70/136] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:19 2022] PUT /identity/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6/users/641b5e5c724f4458b0f4a4af57df9509/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:19.502336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa2901c-f2e1-463c-8c42-e257edec2495 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:19.541926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce63c38-c743-44f0-b615-f5225df021d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:19.542874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce63c38-c743-44f0-b615-f5225df021d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:19.543206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce63c38-c743-44f0-b615-f5225df021d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:19.543488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce63c38-c743-44f0-b615-f5225df021d5 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578/users/641b5e5c724f4458b0f4a4af57df9509/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:19.547332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce63c38-c743-44f0-b615-f5225df021d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6633d5e6015843a5a5c6444f58897578, user_id=641b5e5c724f4458b0f4a4af57df9509, role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:19.548896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce63c38-c743-44f0-b615-f5225df021d5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:19.585845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 67/137] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:19 2022] PUT /identity/v3/projects/6633d5e6015843a5a5c6444f58897578/users/641b5e5c724f4458b0f4a4af57df9509/roles/e2809f949125439eb6f73ac31122b973 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:13:20.073757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13b35-41b2-4d65-b70f-dc930e8622dd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.074168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13b35-41b2-4d65-b70f-dc930e8622dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.074400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff13b35-41b2-4d65-b70f-dc930e8622dd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.076072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 71/138] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:20.081297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d13cb-1365-4506-91df-0defc376baa7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.081778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d13cb-1365-4506-91df-0defc376baa7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.081862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d13cb-1365-4506-91df-0defc376baa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.103358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a72d13cb-1365-4506-91df-0defc376baa7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:20.104583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a72d13cb-1365-4506-91df-0defc376baa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:20.139396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:20.188429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 68/139] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:20.201324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06065-50bb-4de6-bbca-5c1396c09580 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.201957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06065-50bb-4de6-bbca-5c1396c09580 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.201957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d06065-50bb-4de6-bbca-5c1396c09580 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.203338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 72/140] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:20.208794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa458-2261-468e-b2e4-e1c46ada295e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.209097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa458-2261-468e-b2e4-e1c46ada295e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.209384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa458-2261-468e-b2e4-e1c46ada295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.224857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06065-50bb-4de6-bbca-5c1396c09580 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:20.264198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b6aaa458-2261-468e-b2e4-e1c46ada295e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:20.265947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b6aaa458-2261-468e-b2e4-e1c46ada295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:20.394561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 69/141] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:20.422042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d06065-50bb-4de6-bbca-5c1396c09580 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:20.433128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa458-2261-468e-b2e4-e1c46ada295e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:20.494143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:20.494992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.495275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.495552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.514376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:20.522245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:20.524300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:20.526227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 73/142] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:20.532059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:20.604160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:20.614258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa458-2261-468e-b2e4-e1c46ada295e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:20.621504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:20.683801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:20.684531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.684816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.685088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.698723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:20.706864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:20.708594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:20.709498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 70/143] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:20.714046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:20.726734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1c60a-77d3-4f8f-9e28-4a46c594effd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:20.785111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:20.785802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.786082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.786372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.787143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:20.787449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:20.788915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:20.798712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 74/144] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:20.804032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:20.882004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb31cc0-d87c-4644-b6ff-af60dd45b08f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:20.955855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:20.960082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99eae7-66f1-4f10-b785-0b6f91a33e48 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:20.975943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:20.976645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.976927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.977201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:20.977966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:20.978275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:20.979727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:20.997516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 71/145] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:20.998106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:20.999037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:20.999391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:20.999749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:21.005320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:21.005697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:21.006846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:21.008800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 75/146] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:20 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:21.015887 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:21.047749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:21.200050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e67cd0-16db-4cc5-990e-dccf78ce2130 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:21.241775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9906eea-1baf-4a5f-ba31-31486c4c6936 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:21.268054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f42e6-d95f-4d26-aa53-aac86f693f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:21.268729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f42e6-d95f-4d26-aa53-aac86f693f22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:21.269015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f42e6-d95f-4d26-aa53-aac86f693f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:21.269298 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f42e6-d95f-4d26-aa53-aac86f693f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:21.331930 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:21.332331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:21.333477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:21.333971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:21.334468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] PATH_INFO: `/v3/users/8c091920114540d88a55ece0ae3e28cf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:21.339034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] RBAC: Authorizing `identity:get_user(user_id=8c091920114540d88a55ece0ae3e28cf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:21.340549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:21.342592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 72/147] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:21 2022] GET /identity/v3/users/8c091920114540d88a55ece0ae3e28cf => generated 247 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:21.353024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:21.393134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f42e6-d95f-4d26-aa53-aac86f693f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:21.394665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f42e6-d95f-4d26-aa53-aac86f693f22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:21.488686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:21.512272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a603e-0e61-4658-b378-069003a0d8bf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:21.582455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 76/148] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 17:13:21.583841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888af7-c7f0-4c4a-abea-e7aa7c261d5e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:21.584130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888af7-c7f0-4c4a-abea-e7aa7c261d5e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:21.584407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab888af7-c7f0-4c4a-abea-e7aa7c261d5e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:21.585927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 77/149] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:21.590602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888af7-c7f0-4c4a-abea-e7aa7c261d5e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:21.607607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ad131-9c1a-400d-a8a4-ef673de85e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:21.608304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad131-9c1a-400d-a8a4-ef673de85e9c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:21.608661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad131-9c1a-400d-a8a4-ef673de85e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:21.609476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ad131-9c1a-400d-a8a4-ef673de85e9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:21.667743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:21.712353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ad131-9c1a-400d-a8a4-ef673de85e9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:21.713823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ad131-9c1a-400d-a8a4-ef673de85e9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:21.747004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab888af7-c7f0-4c4a-abea-e7aa7c261d5e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:21.796345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:21.812901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 73/150] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 17:13:21.814218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6684d9-b2bc-4a7f-a383-8948a476b3c5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:21.814536 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6684d9-b2bc-4a7f-a383-8948a476b3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:21.814794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6684d9-b2bc-4a7f-a383-8948a476b3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:21.832047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6d6684d9-b2bc-4a7f-a383-8948a476b3c5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:21.833249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d6684d9-b2bc-4a7f-a383-8948a476b3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:21.839583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:21.840501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:21.840787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:21.841055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:21.847067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:21.848578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:21.850409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 78/151] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:21 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:21.851193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:21.901542 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 74/152] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:21.902429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6684d9-b2bc-4a7f-a383-8948a476b3c5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:22.000765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6684d9-b2bc-4a7f-a383-8948a476b3c5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:22.017658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:22.035756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:22.036431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.036717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.036990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.037832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=641b5e5c724f4458b0f4a4af57df9509) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:22.038142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:22.039660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:22.046335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 75/153] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:21 2022] GET /identity/v3/role_assignments?user.id=641b5e5c724f4458b0f4a4af57df9509&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:22.047385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:22.130855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf33102-87aa-4e80-99fb-565dc70788bb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:22.154480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5360a-e321-4d2a-bf09-d5c0a4ada90c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:22.190930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:22.191866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.192148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.192419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.193719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:22.195234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:22.196888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 76/154] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:22.199665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:22.200569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.200850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.201124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.202182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:22.207068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:22.208564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:22.210601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 79/155] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:21 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:22.216050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:22.223759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:22.262716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:22.312968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9bb19-4364-44a7-9536-761d2d649aa2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:22.355229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6520f5-3960-4a93-8943-e67b6c38c7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:22.355965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6520f5-3960-4a93-8943-e67b6c38c7b9 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.356254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6520f5-3960-4a93-8943-e67b6c38c7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.356523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6520f5-3960-4a93-8943-e67b6c38c7b9 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.357254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6520f5-3960-4a93-8943-e67b6c38c7b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:22.358965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6520f5-3960-4a93-8943-e67b6c38c7b9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:22.390895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78a050-9a62-4841-bd5c-f91ad86ff608 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:22.408273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 77/156] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:13:22 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:13:22.437941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004fc34-1ea0-41da-81a5-404f7c6fc6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:22.438727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004fc34-1ea0-41da-81a5-404f7c6fc6fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.439023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004fc34-1ea0-41da-81a5-404f7c6fc6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.439289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004fc34-1ea0-41da-81a5-404f7c6fc6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.440159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004fc34-1ea0-41da-81a5-404f7c6fc6fa None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=8c091920114540d88a55ece0ae3e28cf) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:22.440476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004fc34-1ea0-41da-81a5-404f7c6fc6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:22.441979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004fc34-1ea0-41da-81a5-404f7c6fc6fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:22.448971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 80/157] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:22 2022] GET /identity/v3/role_assignments?user.id=8c091920114540d88a55ece0ae3e28cf&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:22.524044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ad89-8d83-425d-92ee-ed45ec18fc21 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.524603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ad89-8d83-425d-92ee-ed45ec18fc21 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.525054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ad89-8d83-425d-92ee-ed45ec18fc21 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.526673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 78/158] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:22.542882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f0941-153d-4886-afaf-aff005fcbc82 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.543219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f0941-153d-4886-afaf-aff005fcbc82 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.543475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f0941-153d-4886-afaf-aff005fcbc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.567540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d11f0941-153d-4886-afaf-aff005fcbc82 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:22.568793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d11f0941-153d-4886-afaf-aff005fcbc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:22.664613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:22.672694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 81/159] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:22.696497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ad89-8d83-425d-92ee-ed45ec18fc21 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:22.710204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc06b3-a28d-47e7-a2ba-9f2ba2537111 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.710534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc06b3-a28d-47e7-a2ba-9f2ba2537111 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.710778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc06b3-a28d-47e7-a2ba-9f2ba2537111 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.712457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 82/160] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:22.720781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27511e-1f1c-4972-b6da-0ca09f982694 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.721071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27511e-1f1c-4972-b6da-0ca09f982694 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.721351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27511e-1f1c-4972-b6da-0ca09f982694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.742842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8c27511e-1f1c-4972-b6da-0ca09f982694 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:22.744077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8c27511e-1f1c-4972-b6da-0ca09f982694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:22.837801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 83/161] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:22.839640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec117-05f6-44cd-bdc9-2b75c01b01db None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.840127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec117-05f6-44cd-bdc9-2b75c01b01db None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.840613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec117-05f6-44cd-bdc9-2b75c01b01db None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.842257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 84/162] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:22.843940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ad89-8d83-425d-92ee-ed45ec18fc21 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:22.846757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:22.855437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de424de-1578-42d1-94ac-892d41712fa8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.855798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de424de-1578-42d1-94ac-892d41712fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.856147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de424de-1578-42d1-94ac-892d41712fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.882883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1de424de-1578-42d1-94ac-892d41712fa8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:22.884186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1de424de-1578-42d1-94ac-892d41712fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:22.888069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:22.889105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:22.889389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:22.889660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:22.901682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:22.910549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:22.911445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:22.912455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 79/163] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:22.913237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:22.967264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 85/164] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:22.968193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de424de-1578-42d1-94ac-892d41712fa8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.046868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b51342-b51e-4d76-a106-69b8487bb4f3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.053827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.096838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.097572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.097853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.098128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.114365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:23.120114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de424de-1578-42d1-94ac-892d41712fa8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:23.123055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:23.123903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:23.125171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 80/165] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:23.126304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.156752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.173731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.175104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.175349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.175616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.176377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:23.176679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:23.178090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:23.187674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 86/166] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:23.188534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.242650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2f67e-4ff0-43ec-8913-b1e7cd8a980c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.279519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.281518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.282021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.282520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.294538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:23.295888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b59e43-aafa-4f88-9b6a-e15f127a800e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:23.303864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:23.304806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:23.305583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:23.308382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 81/167] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:23.309594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.317820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.337386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.338055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.338364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.338643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.339400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:23.339706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:23.341096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:23.349896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 87/168] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:23.350683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.412388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.423443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6a4e-d9b8-4769-8693-cc2b43d5c91d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.453884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884398-3f6c-47b6-8b0d-54b967c006b2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.464262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.465550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.466024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.466549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.468430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:23.470176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:23.472481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 82/169] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:23.473581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.488920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.489606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.489886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.490162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.490952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:23.491257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:23.492993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:23.501631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 88/170] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:23.502490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.552516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.586618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063bff3-1ad7-447a-ab2b-64ffc1f570cd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.621125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11aab3f-07f7-467a-88ab-88a6d2258c74 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.623311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.624481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.624786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.625157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] PATH_INFO: `/v3/users/641b5e5c724f4458b0f4a4af57df9509` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.626508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=641b5e5c724f4458b0f4a4af57df9509)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:23.628119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:23.629974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 83/171] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/users/641b5e5c724f4458b0f4a4af57df9509 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:23.630825 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.653954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.657836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.658747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.659207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.659688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.728735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:23.730612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:23.743345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd08acd-b29b-469d-b3c9-14f37fb3f3c9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.777997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.778924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.779258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.779472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] PATH_INFO: `/v3/users/d3500a906a204603aefa2c22ce836f2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:23.780889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] RBAC: Authorizing `identity:get_user(user_id=d3500a906a204603aefa2c22ce836f2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:23.782414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:23.782614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.784083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 84/172] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/users/d3500a906a204603aefa2c22ce836f2c => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:23.784937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.852581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 89/173] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:23.854208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:23.885293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:23.906228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd31c3-6894-402a-93a9-f45af83f6bcc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:23.976893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:23.977570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:23.977849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:23.978117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:24.050380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:24.051934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:24.084255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fcaec-4520-4fde-8a2d-569539369ee5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:24.143139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:24.143802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:24.143976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:24.144232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:24.144510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:24.145793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:24.147310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:24.149381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 90/174] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:24.150175 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:24.158945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 85/175] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:24.159830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:24.181704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:24.266827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0eb39-6a01-4d6a-950c-107924fc4280 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:24.302991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:24.304116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:24.304437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:24.304719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578/users/d3500a906a204603aefa2c22ce836f2c/roles/87bf93c8ec484d3595c777a437c6659b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:24.306843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] RBAC: Authorizing `identity:create_grant(project_id=6633d5e6015843a5a5c6444f58897578, user_id=d3500a906a204603aefa2c22ce836f2c, role_id=87bf93c8ec484d3595c777a437c6659b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:24.308415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:24.337658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 86/176] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:24 2022] PUT /identity/v3/projects/6633d5e6015843a5a5c6444f58897578/users/d3500a906a204603aefa2c22ce836f2c/roles/87bf93c8ec484d3595c777a437c6659b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:24.343364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:24.345618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f93b-d436-4168-b6d9-b55d8c2920b6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:24.384170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:24.385060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:24.385343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:24.385616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:24.386875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:24.388361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:24.390567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 91/177] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:24 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:24.396495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:24.440071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:24.500713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdc7d5-96b8-4c4f-b40a-b6d0529656dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:24.538904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:24.539940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:24.540226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:24.540503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] PATH_INFO: `/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:24.541882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] RBAC: Authorizing `identity:get_project(project_id=5ba987b5969d4cc8988cf7f8343da6c6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:24.543394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:24.545211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 87/178] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:24 2022] GET /identity/v3/projects/5ba987b5969d4cc8988cf7f8343da6c6 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:24.548073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:24.552100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:24.573305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5715-bd8d-407f-8d3f-55d03a1ac3ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:24.613325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f544c2a-f129-4eb4-b016-a02e46b468cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:24.614457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f544c2a-f129-4eb4-b016-a02e46b468cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:24.614966 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f544c2a-f129-4eb4-b016-a02e46b468cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:24.615536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f544c2a-f129-4eb4-b016-a02e46b468cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:24.616968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f544c2a-f129-4eb4-b016-a02e46b468cf None admin] RBAC: Adding query filter params (role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=641b5e5c724f4458b0f4a4af57df9509) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:24.617501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f544c2a-f129-4eb4-b016-a02e46b468cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:24.619494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f544c2a-f129-4eb4-b016-a02e46b468cf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:24.627299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 92/179] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:24 2022] GET /identity/v3/role_assignments?user.id=641b5e5c724f4458b0f4a4af57df9509&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=e2809f949125439eb6f73ac31122b973 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:24.689020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f308d4-946d-4a7d-a8b2-b6cb0e1b9a9d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:24.710770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:24.738257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0895d-cc42-4bde-a02a-8af12130aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:24.738982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0895d-cc42-4bde-a02a-8af12130aa43 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:24.739265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0895d-cc42-4bde-a02a-8af12130aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:24.739542 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0895d-cc42-4bde-a02a-8af12130aa43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:24.740394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0895d-cc42-4bde-a02a-8af12130aa43 None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=5ba987b5969d4cc8988cf7f8343da6c6, user.id=641b5e5c724f4458b0f4a4af57df9509) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:24.740712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0895d-cc42-4bde-a02a-8af12130aa43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:24.742569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0895d-cc42-4bde-a02a-8af12130aa43 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:24.749554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 88/180] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:24 2022] GET /identity/v3/role_assignments?user.id=641b5e5c724f4458b0f4a4af57df9509&scope.project.id=5ba987b5969d4cc8988cf7f8343da6c6&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:25.123581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc77ff-f1f4-41da-a23b-3f49b4c121f7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.124555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc77ff-f1f4-41da-a23b-3f49b4c121f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.124847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc77ff-f1f4-41da-a23b-3f49b4c121f7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.126425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 93/181] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:25.132458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f8d3-c9e5-49f8-add6-fc3c8323d2f0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.132753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f8d3-c9e5-49f8-add6-fc3c8323d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.133033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56f8d3-c9e5-49f8-add6-fc3c8323d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.154226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-be56f8d3-c9e5-49f8-add6-fc3c8323d2f0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:25.157384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be56f8d3-c9e5-49f8-add6-fc3c8323d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:25.243523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 89/182] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:25.281855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc77ff-f1f4-41da-a23b-3f49b4c121f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:25.401461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc77ff-f1f4-41da-a23b-3f49b4c121f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:25.438027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:25.438969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.439253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.439528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.450596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:25.458546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:25.459397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:25.460168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 94/183] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:25.469081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f8d3-c9e5-49f8-add6-fc3c8323d2f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:25.575891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56f8d3-c9e5-49f8-add6-fc3c8323d2f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:25.588229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:25.614441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436473a5-c5b2-4b34-83f2-5d8d320434a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:25.615126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436473a5-c5b2-4b34-83f2-5d8d320434a3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.615413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436473a5-c5b2-4b34-83f2-5d8d320434a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.615688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436473a5-c5b2-4b34-83f2-5d8d320434a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.616823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436473a5-c5b2-4b34-83f2-5d8d320434a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:25.617132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436473a5-c5b2-4b34-83f2-5d8d320434a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:25.618580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436473a5-c5b2-4b34-83f2-5d8d320434a3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:25.627721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 90/184] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:25.633514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:25.637854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:25.694976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527494-e02d-419f-a349-cc4eda75fee0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.695165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527494-e02d-419f-a349-cc4eda75fee0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.695439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527494-e02d-419f-a349-cc4eda75fee0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.696826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 91/185] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:25.701612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c661108-2c88-4fe2-b81c-aa732c778dc6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.701896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c661108-2c88-4fe2-b81c-aa732c778dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.702173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c661108-2c88-4fe2-b81c-aa732c778dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.720362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0c661108-2c88-4fe2-b81c-aa732c778dc6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:25.721761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0c661108-2c88-4fe2-b81c-aa732c778dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:25.740397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67141f03-a10b-4348-a20d-07bac3c3a425 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:25.775762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:25.776667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.776944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.777215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] PATH_INFO: `/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.790824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] RBAC: Authorizing `identity:get_user(user_id=3b7ca808bc4d4eb8b8d8034be9fe6034)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:25.791887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 92/186] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:25.793014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4519b87-1714-4448-9dc7-b94be53c54cf None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.793299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4519b87-1714-4448-9dc7-b94be53c54cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.793573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4519b87-1714-4448-9dc7-b94be53c54cf None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.795034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 93/187] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:25.800393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2201b4-0d1c-4d92-b285-e1637f619e97 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.800675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2201b4-0d1c-4d92-b285-e1637f619e97 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.800944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2201b4-0d1c-4d92-b285-e1637f619e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:25.803279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:25.809972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 95/188] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:25 2022] GET /identity/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:25.812332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:25.822225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4e2201b4-0d1c-4d92-b285-e1637f619e97 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:25.823437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4e2201b4-0d1c-4d92-b285-e1637f619e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:25.878971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:25.902785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 94/189] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:25.902785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2201b4-0d1c-4d92-b285-e1637f619e97 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:25.931738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207752b4-6aa9-4415-825d-908f66b47ace None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:25.934302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:25.973581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:25.974162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:25.974477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:25.974755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.008484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2201b4-0d1c-4d92-b285-e1637f619e97 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.050908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.051882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.052287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.052571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.052732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:26.053767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:26.054247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:26.055244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:26.058197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 95/190] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:26.058912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:26.117670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:26.164514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 96/191] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 17:13:26.165343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:26.172340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:26.175744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5bbdf-1ac9-4b9a-8628-20610128edc2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.211878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.212699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.212979 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.213252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.224361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:26.232053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:26.232924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:26.233923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 96/192] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:26.234725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:26.276635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f942a-715b-4f21-9f8f-7f4b99833cb4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.312804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.313857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.314356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.314844 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.315764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:26.317430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:26.338073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 97/193] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:13:26 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:26.339237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:26.354267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179d831-63e4-481f-a9b5-5fed54cae353 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.367784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:26.402871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.404319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.404612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.404895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.406645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:26.408478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:26.410902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 97/194] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:26 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:26.416967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:26.457842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:26.476858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c77b7-bd95-4e5f-bfa6-20e36a9e3ff3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.519516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.520687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.521161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.521672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.522683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:26.523183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:26.524831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:26.535484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 98/195] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:26.542794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:26.555379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3316fb8-68df-4644-80e2-01203ebc0786 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.610386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.611375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.613333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.613333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.613333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=3b7ca808bc4d4eb8b8d8034be9fe6034) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:26.613333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:26.617258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:26.625047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 98/196] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:26 2022] GET /identity/v3/role_assignments?user.id=3b7ca808bc4d4eb8b8d8034be9fe6034&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:26.653653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:26.680389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339693bd-4678-4991-bdef-f1dee362b2f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.729208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7910aa0-65ea-4c49-9124-d1f8cb21f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.730057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910aa0-65ea-4c49-9124-d1f8cb21f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.730365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910aa0-65ea-4c49-9124-d1f8cb21f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.730650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7910aa0-65ea-4c49-9124-d1f8cb21f5d9 None admin] PATH_INFO: `/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.731959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910aa0-65ea-4c49-9124-d1f8cb21f5d9 None admin] RBAC: Authorizing `identity:get_user(user_id=3b7ca808bc4d4eb8b8d8034be9fe6034)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:26.733524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7910aa0-65ea-4c49-9124-d1f8cb21f5d9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:26.736014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 99/197] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:26 2022] GET /identity/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:26.741683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:26.854064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:26.866018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b235-70d5-496c-ba0c-f61ea1d2438e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:26.903589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:26.904262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.904544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.904813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.921814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1717cfd-6b94-46eb-ae3e-e124f86be963 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.922626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1717cfd-6b94-46eb-ae3e-e124f86be963 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.923208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1717cfd-6b94-46eb-ae3e-e124f86be963 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.925165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 100/198] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:26.934834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfed1b-fda4-4257-a0bd-b3d07fbfbdd0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:26.935417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfed1b-fda4-4257-a0bd-b3d07fbfbdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:26.935911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfed1b-fda4-4257-a0bd-b3d07fbfbdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:26.955845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-69bfed1b-fda4-4257-a0bd-b3d07fbfbdd0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:26.957387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69bfed1b-fda4-4257-a0bd-b3d07fbfbdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:27.018925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:27.020326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:27.062967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 101/199] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:27.110864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfed1b-fda4-4257-a0bd-b3d07fbfbdd0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:27.170660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:27.189132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 99/200] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:27.195744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:27.262655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:27.294124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfed1b-fda4-4257-a0bd-b3d07fbfbdd0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:27.333413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:27.334666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:27.335148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:27.335617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:27.346779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:27.355047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:27.355924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:27.356744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:27.359742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 102/201] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:27.366110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:27.406994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68062024-df21-4f23-8ff3-52872d650d9f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:27.476631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:27.477900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:27.478408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:27.478878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:27.481007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:27.483406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:27.488408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 100/202] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:27 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:27.499304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:27.527884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f548e-8951-4b98-9a3f-6afda4e9b8ad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:27.574137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:27.574880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:27.575157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:27.575435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:27.576219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:27.576525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:27.580294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:27.586036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:27.601931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 103/203] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:27.611130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:27.611621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:27.697296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f476e82-6dce-47e3-897f-1137d1792962 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:27.763690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:27.764363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:27.764644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:27.764993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:27.766233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] RBAC: Adding query filter params (role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=3b7ca808bc4d4eb8b8d8034be9fe6034) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:27.766571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:27.768035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:27.787112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 101/204] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:27 2022] GET /identity/v3/role_assignments?user.id=3b7ca808bc4d4eb8b8d8034be9fe6034&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=e2809f949125439eb6f73ac31122b973 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:27.794957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e6c0-91d8-42c7-88ed-b7b81668f3bf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:27.842123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:27.843098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:27.843385 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:27.843672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] PATH_INFO: `/v3/users/d3500a906a204603aefa2c22ce836f2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:27.845177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] RBAC: Authorizing `identity:get_user(user_id=d3500a906a204603aefa2c22ce836f2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:27.846801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:27.849015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 104/205] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:27 2022] GET /identity/v3/users/d3500a906a204603aefa2c22ce836f2c => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:27.854663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:27.976420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9888c3-421d-4bc3-b237-c9061eaa89bb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:28.002687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:28.013560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:28.014232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:28.014553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:28.015293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:28.095751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:28.097154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:28.218929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 102/206] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:28.224383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:28.304359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:28.338732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4656d-c767-442c-897b-18b03906ed92 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:28.373582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcd339-f59a-4b5c-abce-8f8704a53379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:28.374487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd339-f59a-4b5c-abce-8f8704a53379 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:28.374994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd339-f59a-4b5c-abce-8f8704a53379 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:28.374994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcd339-f59a-4b5c-abce-8f8704a53379 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:28.376171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd339-f59a-4b5c-abce-8f8704a53379 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:28.377701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fcd339-f59a-4b5c-abce-8f8704a53379 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:28.379706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 105/207] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:28 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:28.387604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:28.417657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:28.512829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99163-ce84-41ea-8cb8-d61a87655dac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:28.547690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73532b6-324d-4dc9-9bde-e234a5084795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:28.548361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73532b6-324d-4dc9-9bde-e234a5084795 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:28.548645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73532b6-324d-4dc9-9bde-e234a5084795 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:28.548916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73532b6-324d-4dc9-9bde-e234a5084795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:28.549759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73532b6-324d-4dc9-9bde-e234a5084795 None admin] RBAC: Adding query filter params (role.id=87bf93c8ec484d3595c777a437c6659b, scope.project.id=6633d5e6015843a5a5c6444f58897578, user.id=d3500a906a204603aefa2c22ce836f2c) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:28.550070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73532b6-324d-4dc9-9bde-e234a5084795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:28.551581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73532b6-324d-4dc9-9bde-e234a5084795 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:28.558006 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 103/208] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:28 2022] GET /identity/v3/role_assignments?user.id=d3500a906a204603aefa2c22ce836f2c&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=87bf93c8ec484d3595c777a437c6659b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:28.939727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb8888-870c-4c98-9b47-f7a5065e69dd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:28.940276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb8888-870c-4c98-9b47-f7a5065e69dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:28.940276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb8888-870c-4c98-9b47-f7a5065e69dd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:28.941650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 106/209] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:28.946942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e94c2-724e-4907-aa52-171cdcada142 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:28.947343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e94c2-724e-4907-aa52-171cdcada142 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:28.947529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e94c2-724e-4907-aa52-171cdcada142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:28.967862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-202e94c2-724e-4907-aa52-171cdcada142 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:28.969196 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-202e94c2-724e-4907-aa52-171cdcada142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:29.053784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 104/210] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:29.077038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e94c2-724e-4907-aa52-171cdcada142 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.077679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711802e-b895-4d42-b5fa-7c635bc94924 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.078370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711802e-b895-4d42-b5fa-7c635bc94924 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.078370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711802e-b895-4d42-b5fa-7c635bc94924 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.080181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 107/211] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:29.086407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7331-ec4a-4873-931c-b5565bbc0061 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.087146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7331-ec4a-4873-931c-b5565bbc0061 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.087428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7331-ec4a-4873-931c-b5565bbc0061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.100993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:29.109860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c0ac7331-ec4a-4873-931c-b5565bbc0061 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:29.113266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c0ac7331-ec4a-4873-931c-b5565bbc0061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:29.189139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e94c2-724e-4907-aa52-171cdcada142 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.196782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 108/212] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:29.218489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7331-ec4a-4873-931c-b5565bbc0061 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.227181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed618a4-844f-433e-b527-d6fa27f151f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.227994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed618a4-844f-433e-b527-d6fa27f151f2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.228272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed618a4-844f-433e-b527-d6fa27f151f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.228543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed618a4-844f-433e-b527-d6fa27f151f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.239995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed618a4-844f-433e-b527-d6fa27f151f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-eed618a4-844f-433e-b527-d6fa27f151f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:29.248043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:29.249001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 105/213] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:29.250952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838776-9c5e-4057-b28b-75fedc927447 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.251677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838776-9c5e-4057-b28b-75fedc927447 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.251677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838776-9c5e-4057-b28b-75fedc927447 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.256744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 106/214] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:29.256744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838776-9c5e-4057-b28b-75fedc927447 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.294154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:29.337223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7331-ec4a-4873-931c-b5565bbc0061 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.340548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:29.369550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838776-9c5e-4057-b28b-75fedc927447 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.376010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90139d92-4d95-4ef7-8125-6aaf34db7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.376844 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139d92-4d95-4ef7-8125-6aaf34db7db8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.377237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139d92-4d95-4ef7-8125-6aaf34db7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.377508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90139d92-4d95-4ef7-8125-6aaf34db7db8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.388296 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90139d92-4d95-4ef7-8125-6aaf34db7db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-90139d92-4d95-4ef7-8125-6aaf34db7db8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:29.396747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:29.397638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:29.398450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 109/215] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:29.403590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269bf70-455b-43d3-8b96-d3e43a847410 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.403896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269bf70-455b-43d3-8b96-d3e43a847410 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.404160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269bf70-455b-43d3-8b96-d3e43a847410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.410634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.411541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.411830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.412104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.412868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:29.413174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:29.414586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:29.421932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6269bf70-455b-43d3-8b96-d3e43a847410 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:29.423169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6269bf70-455b-43d3-8b96-d3e43a847410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:29.423745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 107/216] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:29.427199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.498551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 110/217] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:29.498551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269bf70-455b-43d3-8b96-d3e43a847410 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.542416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1252960-3f6c-4d4f-821f-38743f64cb64 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.555910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:29.583379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.584029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.584323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.584591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.585344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:29.585646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:29.587043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:29.598201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 108/218] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:29.599052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.601748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:29.609448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269bf70-455b-43d3-8b96-d3e43a847410 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.647957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.649305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.649730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.650136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] PATH_INFO: `/v3/users/d6ff15e9162f411b93ebfc04af28debf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.671302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] RBAC: Authorizing `identity:get_user(user_id=d6ff15e9162f411b93ebfc04af28debf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:29.673064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:29.674900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 111/219] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/users/d6ff15e9162f411b93ebfc04af28debf => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:29.675672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.714900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710744c-0cf0-4fd3-bac8-dfd7b25293c0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.751462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.752184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.752466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.752736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.754103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:29.755634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:29.757447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 109/220] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:29.758037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.800126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25bf59-10e2-4b75-9452-35665de1e36a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.815186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:29.834476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:29.839528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.840420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.840697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.840954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] PATH_INFO: `/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.842155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] RBAC: Authorizing `identity:get_user(user_id=3b7ca808bc4d4eb8b8d8034be9fe6034)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:29.843692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:29.849685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 112/221] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:29.849685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:29.868174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d100a0e-9d73-4753-8298-001622f64722 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.904095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:29.904762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:29.905047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:29.905325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:29.957177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bc2fb-c504-4574-887d-6c2cfab37900 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:29.983725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:29.985196 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:30.003265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:30.004292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.004923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.005163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.005900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:30.007621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:30.031195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 113/222] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:13:29 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:30.035375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:30.065954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:30.102048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:30.104382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 110/223] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:30.111758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:30.191220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cef20-8512-456e-aeef-788d26aabe48 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:30.232327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:30.233237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.233634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.234010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.235287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:30.235696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e35c9-c05d-46c6-9485-1900804c2902 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:30.236785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:30.238603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 114/224] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:30 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:30.244871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:30.285370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e162011-a774-45c6-bf4e-a4e691faeb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:30.286158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e162011-a774-45c6-bf4e-a4e691faeb72 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.286483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e162011-a774-45c6-bf4e-a4e691faeb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.286724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e162011-a774-45c6-bf4e-a4e691faeb72 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.287994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e162011-a774-45c6-bf4e-a4e691faeb72 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:30.289434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e162011-a774-45c6-bf4e-a4e691faeb72 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:30.291213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 111/225] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:30 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:30.292682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330235-96fb-4d83-9885-217301ba2b75 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.292948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330235-96fb-4d83-9885-217301ba2b75 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.293201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330235-96fb-4d83-9885-217301ba2b75 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.294724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 112/226] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:30.300622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330235-96fb-4d83-9885-217301ba2b75 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:30.353306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:30.407306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a56ed9-f6a2-4bea-86b5-9525aa9e3455 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:30.420306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:30.446939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330235-96fb-4d83-9885-217301ba2b75 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:30.458721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776083c-61c5-474c-91c2-c68765d67034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:30.460032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776083c-61c5-474c-91c2-c68765d67034 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.460318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776083c-61c5-474c-91c2-c68765d67034 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.460596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776083c-61c5-474c-91c2-c68765d67034 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/3b7ca808bc4d4eb8b8d8034be9fe6034/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.463208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776083c-61c5-474c-91c2-c68765d67034 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed608294e8234fb3af659f8ca022de2c, user_id=3b7ca808bc4d4eb8b8d8034be9fe6034, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:30.464855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776083c-61c5-474c-91c2-c68765d67034 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:30.480512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 115/227] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:30 2022] PUT /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/3b7ca808bc4d4eb8b8d8034be9fe6034/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:13:30.481781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537f81-d0d7-4b94-8ba1-78430d08489b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.482096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537f81-d0d7-4b94-8ba1-78430d08489b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.482387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54537f81-d0d7-4b94-8ba1-78430d08489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.500525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-54537f81-d0d7-4b94-8ba1-78430d08489b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:30.501725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-54537f81-d0d7-4b94-8ba1-78430d08489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:30.502074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:30.503018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.503440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.503954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.505080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=d6ff15e9162f411b93ebfc04af28debf) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:30.505542 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:30.507316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:30.516202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 113/228] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:30 2022] GET /identity/v3/role_assignments?user.id=d6ff15e9162f411b93ebfc04af28debf&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:30.591491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 116/229] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:30.616066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:30.792407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9e10e-712a-4fcf-917e-4c5886d22225 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:30.794909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:30.835188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:30.836272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:30.836551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:30.836820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:30.850276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:30.859230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:30.860191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:30.860966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:30.863757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 114/230] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:30.869911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537f81-d0d7-4b94-8ba1-78430d08489b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:30.969166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:30.975281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54537f81-d0d7-4b94-8ba1-78430d08489b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:31.013021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:31.013707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:31.013983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:31.014254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:31.015168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:31.015476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:31.016867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:31.029396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 117/231] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:31.032323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:31.138524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cca524-6b45-40b4-8753-81e117627057 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:31.174417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:31.175311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:31.175591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:31.175864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] PATH_INFO: `/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:31.177069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] RBAC: Authorizing `identity:get_user(user_id=3b7ca808bc4d4eb8b8d8034be9fe6034)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:31.178563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:31.184935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 115/232] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:31 2022] GET /identity/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:31.186369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:31.289065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5e59b-d42c-4229-ba79-c3044e29a28c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:31.324453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8ebf-b637-4ce8-ae12-d184af7486d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:31.325339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8ebf-b637-4ce8-ae12-d184af7486d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:31.325617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8ebf-b637-4ce8-ae12-d184af7486d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:31.325889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8ebf-b637-4ce8-ae12-d184af7486d0 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:31.327107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8ebf-b637-4ce8-ae12-d184af7486d0 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:31.328817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8ebf-b637-4ce8-ae12-d184af7486d0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:31.334387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 118/233] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:31 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:31.336718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:31.374927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:31.441183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9355c37-d2ef-463a-acd1-844056bcbee5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:31.475393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fd38f-b63b-4372-832d-1957e42c0680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:31.476296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd38f-b63b-4372-832d-1957e42c0680 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:31.476576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd38f-b63b-4372-832d-1957e42c0680 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:31.476853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fd38f-b63b-4372-832d-1957e42c0680 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/3b7ca808bc4d4eb8b8d8034be9fe6034/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:31.479070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fd38f-b63b-4372-832d-1957e42c0680 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed608294e8234fb3af659f8ca022de2c, user_id=3b7ca808bc4d4eb8b8d8034be9fe6034, role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:31.480519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fd38f-b63b-4372-832d-1957e42c0680 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:31.506458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 116/234] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:31 2022] PUT /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/3b7ca808bc4d4eb8b8d8034be9fe6034/roles/e2809f949125439eb6f73ac31122b973 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:32.692751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15507a-409e-499c-8f0b-0a2a002a1288 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:32.693264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15507a-409e-499c-8f0b-0a2a002a1288 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:32.693338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15507a-409e-499c-8f0b-0a2a002a1288 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:32.694965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 119/235] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:32.700373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7746c7-2dbc-4ad9-8dd6-379fa6db4777 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:32.700785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7746c7-2dbc-4ad9-8dd6-379fa6db4777 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:32.700963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7746c7-2dbc-4ad9-8dd6-379fa6db4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:32.725643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1a7746c7-2dbc-4ad9-8dd6-379fa6db4777 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:32.726863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a7746c7-2dbc-4ad9-8dd6-379fa6db4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:32.813468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884b6d-8f9c-4c20-a4d0-8852f4624692 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:32.813815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884b6d-8f9c-4c20-a4d0-8852f4624692 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:32.814026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93884b6d-8f9c-4c20-a4d0-8852f4624692 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:32.815700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 120/236] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:32.824481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 117/237] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:32.825408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c7aed-f89d-4d01-bdbc-40a27955c80c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:32.825895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c7aed-f89d-4d01-bdbc-40a27955c80c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:32.826414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c7aed-f89d-4d01-bdbc-40a27955c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:32.847880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7746c7-2dbc-4ad9-8dd6-379fa6db4777 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:32.860979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a00c7aed-f89d-4d01-bdbc-40a27955c80c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:32.862517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a00c7aed-f89d-4d01-bdbc-40a27955c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:32.870664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:32.914320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:32.954453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7746c7-2dbc-4ad9-8dd6-379fa6db4777 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:32.990267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:32.991127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:32.991751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:32.992025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.003551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:33.011385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:33.012260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:33.013049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 118/238] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:33.019032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.063994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 121/239] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:33.102781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:33.107392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c7aed-f89d-4d01-bdbc-40a27955c80c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.121726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe4b7a-5a3b-47ac-8d09-a05c5a3b55cf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:33.155658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:33.156383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.156794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.157075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.157893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:33.158206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:33.159623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:33.169193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 119/240] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:33.175132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.276574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6369d4-c9e5-43f7-8b8a-6e0b8b730954 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:33.312932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:33.313829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.314109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.314413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] PATH_INFO: `/v3/users/ed5b9aa3d97f42bc9819e5c94a936f30` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.330409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:33.331933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] RBAC: Authorizing `identity:get_user(user_id=ed5b9aa3d97f42bc9819e5c94a936f30)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:33.333412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:33.336475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 120/241] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/users/ed5b9aa3d97f42bc9819e5c94a936f30 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:33.343340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.405136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c7aed-f89d-4d01-bdbc-40a27955c80c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:33.441029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f15fc6-ca78-4a1a-885b-82b6e8a77b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:33.441853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15fc6-ca78-4a1a-885b-82b6e8a77b7e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.442131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15fc6-ca78-4a1a-885b-82b6e8a77b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.442434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f15fc6-ca78-4a1a-885b-82b6e8a77b7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.443610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15fc6-ca78-4a1a-885b-82b6e8a77b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:33.445069 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f15fc6-ca78-4a1a-885b-82b6e8a77b7e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:33.446762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 122/242] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:33.450974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f61d6-4f18-4139-a27f-7a562cbe407f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.450974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f61d6-4f18-4139-a27f-7a562cbe407f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.450974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f61d6-4f18-4139-a27f-7a562cbe407f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.450974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 123/243] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:33.450974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8fdd-402d-41e1-a65f-b90723143018 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.451499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8fdd-402d-41e1-a65f-b90723143018 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.451872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f8fdd-402d-41e1-a65f-b90723143018 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.453636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 124/244] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:33.455228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ff4c8-9dcc-4fc0-a569-1e55a8e26014 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.455581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ff4c8-9dcc-4fc0-a569-1e55a8e26014 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.455854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ff4c8-9dcc-4fc0-a569-1e55a8e26014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.473594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-974ff4c8-9dcc-4fc0-a569-1e55a8e26014 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:33.474811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-974ff4c8-9dcc-4fc0-a569-1e55a8e26014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:33.477860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8894-6f35-448e-8942-c1edae7d8770 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:33.493751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:33.513616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784132c-d1a9-4498-9f58-9a1a6bbed9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:33.514275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784132c-d1a9-4498-9f58-9a1a6bbed9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.514582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784132c-d1a9-4498-9f58-9a1a6bbed9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.515058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784132c-d1a9-4498-9f58-9a1a6bbed9e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.554358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 125/245] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:33.555620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ff4c8-9dcc-4fc0-a569-1e55a8e26014 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.593294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:33.596511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784132c-d1a9-4498-9f58-9a1a6bbed9e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:33.598194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784132c-d1a9-4498-9f58-9a1a6bbed9e3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:33.668741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ff4c8-9dcc-4fc0-a569-1e55a8e26014 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:33.706143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 121/246] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:33.707496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d2b65-97a7-4988-804d-f7647bd2554c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.707785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d2b65-97a7-4988-804d-f7647bd2554c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.708061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d2b65-97a7-4988-804d-f7647bd2554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.711996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:33.712689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.712970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.713239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.713989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:33.715804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:33.726469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b93d2b65-97a7-4988-804d-f7647bd2554c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:33.727671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b93d2b65-97a7-4988-804d-f7647bd2554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:33.738125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 126/247] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:13:33 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:33.739487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.764001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:33.801826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 122/248] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:33.802750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d2b65-97a7-4988-804d-f7647bd2554c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.835889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:33.887602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c49c7-e1a7-421a-91a9-dda8e6901385 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:33.916124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d2b65-97a7-4988-804d-f7647bd2554c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:33.928096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:33.928849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.929127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.929400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.941834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:33.950179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:33.951114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:33.951895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 127/249] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:33.952847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:33.958458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253c52d-19e7-45ee-b18f-60c232697c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:33.959387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253c52d-19e7-45ee-b18f-60c232697c4d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.959665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253c52d-19e7-45ee-b18f-60c232697c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.959946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253c52d-19e7-45ee-b18f-60c232697c4d None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.961533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253c52d-19e7-45ee-b18f-60c232697c4d None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:33.962722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253c52d-19e7-45ee-b18f-60c232697c4d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:33.964448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 123/250] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:33.965716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b965-a8ca-4775-baea-9931ec72f03e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:33.966003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b965-a8ca-4775-baea-9931ec72f03e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:33.966278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b965-a8ca-4775-baea-9931ec72f03e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:33.967578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 124/251] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:33.968322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b965-a8ca-4775-baea-9931ec72f03e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.040502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:34.083317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de6060-257a-479c-914a-154fc4c971dd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.102385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b965-a8ca-4775-baea-9931ec72f03e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.102385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:34.128696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.129657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.130007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.131332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.141547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abf8be-f68e-4854-933e-35f4b4592df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.142235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf8be-f68e-4854-933e-35f4b4592df4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.142574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf8be-f68e-4854-933e-35f4b4592df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.142842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abf8be-f68e-4854-933e-35f4b4592df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.143604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf8be-f68e-4854-933e-35f4b4592df4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:34.143701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:34.143909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf8be-f68e-4854-933e-35f4b4592df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:34.145293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abf8be-f68e-4854-933e-35f4b4592df4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:34.151806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:34.152720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:34.153534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 128/252] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:34.154186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.165393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 125/253] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:34.172187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854df8-85cc-465f-9418-482a18b0d387 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.172750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854df8-85cc-465f-9418-482a18b0d387 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.173223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08854df8-85cc-465f-9418-482a18b0d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.192821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-08854df8-85cc-465f-9418-482a18b0d387 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:34.194402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08854df8-85cc-465f-9418-482a18b0d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:34.271102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 126/254] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:34.272141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854df8-85cc-465f-9418-482a18b0d387 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.285827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66efcc7-cb09-4743-a1d4-3ffc21769d6c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.328902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:34.336365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198b720-810e-4928-951e-167600d5e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.337154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198b720-810e-4928-951e-167600d5e698 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.337543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198b720-810e-4928-951e-167600d5e698 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.338480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198b720-810e-4928-951e-167600d5e698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.339446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198b720-810e-4928-951e-167600d5e698 None admin] RBAC: Adding query filter params (role.id=87bf93c8ec484d3595c777a437c6659b, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=ed5b9aa3d97f42bc9819e5c94a936f30) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:34.340088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198b720-810e-4928-951e-167600d5e698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:34.342269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198b720-810e-4928-951e-167600d5e698 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:34.351018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 129/255] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/role_assignments?user.id=ed5b9aa3d97f42bc9819e5c94a936f30&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=87bf93c8ec484d3595c777a437c6659b => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:34.351924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198b720-810e-4928-951e-167600d5e698 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.385630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:34.400038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08854df8-85cc-465f-9418-482a18b0d387 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.444906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.445998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.446491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.446972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.447967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:34.448487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:34.450161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:34.471200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 127/256] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:34.473743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.534339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198b720-810e-4928-951e-167600d5e698 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.598955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.600168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.600646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.601156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] PATH_INFO: `/v3/users/d6ff15e9162f411b93ebfc04af28debf` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.602670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] RBAC: Authorizing `identity:get_user(user_id=d6ff15e9162f411b93ebfc04af28debf)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:34.605004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:34.607295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 130/257] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/users/d6ff15e9162f411b93ebfc04af28debf => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:34.608355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.684628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:34.709672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ae5ed-88b1-492e-8e3d-066c07ec01ca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.734593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188efe1-9588-4eef-9307-b0c2f4ff6c0d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.775798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.777058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.777536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.778006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] PATH_INFO: `/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.779853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] RBAC: Authorizing `identity:get_user(user_id=3b7ca808bc4d4eb8b8d8034be9fe6034)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:34.782677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:34.784982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 131/258] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:34.786230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.791717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.792549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.792831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.793102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.823700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:34.840972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:34.841924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 128/259] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:34.843950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:34.879768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:34.907671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cf823-cff4-4465-9e3a-48799776ac88 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:34.941891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:34.950747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:34.951956 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:34.953041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:34.953529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:34.958326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:34.958326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:34.960077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 132/260] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:34.960797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:35.047172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7edd1-33a6-464b-a658-673cc9d9375e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:35.110272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:35.110960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:35.111230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:35.111501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:35.150329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c845c-43be-4d04-804e-53f51682b83f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:35.215892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:35.216499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:35.216779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:35.217051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:35.217994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:35.218321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:35.219761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:35.239269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 133/261] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:35.240119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:35.245015 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:35.246539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:35.272449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:35.351566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:35.419432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0add-ba22-418b-a5b5-14321e455877 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:35.429976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 129/262] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:35.430866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:35.499151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:35.500413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:35.500702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:35.500980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/d6ff15e9162f411b93ebfc04af28debf/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:35.503028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] RBAC: Authorizing `identity:create_grant(project_id=ed608294e8234fb3af659f8ca022de2c, user_id=d6ff15e9162f411b93ebfc04af28debf, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:35.504501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:35.533044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 134/263] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:35 2022] PUT /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/d6ff15e9162f411b93ebfc04af28debf/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:35.539295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:35.544728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c5048-5c2e-43b8-8be2-e73ff647ae9c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:35.563801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:35.595820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:35.597212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:35.597648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:35.598069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] PATH_INFO: `/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:35.600837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] RBAC: Authorizing `identity:get_user(user_id=3b7ca808bc4d4eb8b8d8034be9fe6034)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:35.602611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:35.604533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 130/264] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:35 2022] GET /identity/v3/users/3b7ca808bc4d4eb8b8d8034be9fe6034 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:35.612424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:35.739167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde1110-e12e-4794-9716-fb95de4473ce None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:35.785675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197486dd-775c-470a-b1aa-932bbc6c179a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:35.787188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:35.820002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:35.821826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:35.822539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:35.823659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:35.826442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:35.828433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:35.832144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 135/265] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:35 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:35.840893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:35.849399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04550a18-4068-41d5-a758-6e341aac55d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:35.850437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550a18-4068-41d5-a758-6e341aac55d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:35.853464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550a18-4068-41d5-a758-6e341aac55d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:35.854008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04550a18-4068-41d5-a758-6e341aac55d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:35.958353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:36.003401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04550a18-4068-41d5-a758-6e341aac55d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:36.004903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04550a18-4068-41d5-a758-6e341aac55d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:36.024178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca3990-e5b4-42ea-84be-232d973ce807 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:36.060288 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:36.061345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.061930 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.062541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.063575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=3b7ca808bc4d4eb8b8d8034be9fe6034) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:36.064075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:36.065728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:36.072482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 136/266] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:35 2022] GET /identity/v3/role_assignments?user.id=3b7ca808bc4d4eb8b8d8034be9fe6034&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:36.224101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 131/267] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:36.231413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:36.308625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce1cb2-a004-48cc-bb2c-4cafc4385e3f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.308972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce1cb2-a004-48cc-bb2c-4cafc4385e3f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.309195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce1cb2-a004-48cc-bb2c-4cafc4385e3f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.310689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 132/268] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:36.316079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41ba2-1301-4d5b-812b-c45500a225b5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.316373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41ba2-1301-4d5b-812b-c45500a225b5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.316659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae41ba2-1301-4d5b-812b-c45500a225b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.322969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:36.354339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ae41ba2-1301-4d5b-812b-c45500a225b5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:36.355589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ae41ba2-1301-4d5b-812b-c45500a225b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:36.377481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f40fe-f574-4b1b-be4c-cc881c08a646 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:36.414383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:36.415666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.416159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.416618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.418010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:36.419712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:36.422334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 137/269] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:36 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:36.429091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:36.495703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 133/270] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 17:13:36.533328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41ba2-1301-4d5b-812b-c45500a225b5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:36.559451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:36.635784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff0dce-79d5-4aac-bf3d-87e49611c2fe None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:36.658921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:36.674691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f666-d932-4238-ac5f-948155be6365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:36.675367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f666-d932-4238-ac5f-948155be6365 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.675651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f666-d932-4238-ac5f-948155be6365 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.675928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f666-d932-4238-ac5f-948155be6365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.676769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f666-d932-4238-ac5f-948155be6365 None admin] RBAC: Adding query filter params (role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=3b7ca808bc4d4eb8b8d8034be9fe6034) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:36.677083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f666-d932-4238-ac5f-948155be6365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:36.678573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f666-d932-4238-ac5f-948155be6365 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:36.681859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae41ba2-1301-4d5b-812b-c45500a225b5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:36.685293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 138/271] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:36 2022] GET /identity/v3/role_assignments?user.id=3b7ca808bc4d4eb8b8d8034be9fe6034&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=e2809f949125439eb6f73ac31122b973 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:36.686641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb925d-2733-4039-a5a1-6ae2edb73d31 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.687569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb925d-2733-4039-a5a1-6ae2edb73d31 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.687852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb925d-2733-4039-a5a1-6ae2edb73d31 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.689124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 139/272] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:36.694779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ecae1-8319-44bf-acb2-386f5a607b6f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.695136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ecae1-8319-44bf-acb2-386f5a607b6f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.695477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ecae1-8319-44bf-acb2-386f5a607b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.736121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d54ecae1-8319-44bf-acb2-386f5a607b6f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:36.738202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d54ecae1-8319-44bf-acb2-386f5a607b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:36.757493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:36.758375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:36.758663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:36.758934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:36.783242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:36.797095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:36.799681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:36.801597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:36.806662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 134/273] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:36.809981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:36.897418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 140/274] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:36.924742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ecae1-8319-44bf-acb2-386f5a607b6f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:36.929856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:36.970534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fd515-fb95-449f-b198-5a1bd4019a64 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.017640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf0b5-41e3-462b-ad4d-50c1bd6c0903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.018448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf0b5-41e3-462b-ad4d-50c1bd6c0903 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.019433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf0b5-41e3-462b-ad4d-50c1bd6c0903 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.019713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf0b5-41e3-462b-ad4d-50c1bd6c0903 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.020485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf0b5-41e3-462b-ad4d-50c1bd6c0903 None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:37.021727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf0b5-41e3-462b-ad4d-50c1bd6c0903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.023196 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf0b5-41e3-462b-ad4d-50c1bd6c0903 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.035670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 135/275] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:37.037237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a4c4-31bc-4363-879a-d5c21d065486 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.037632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a4c4-31bc-4363-879a-d5c21d065486 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.038412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6a4c4-31bc-4363-879a-d5c21d065486 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.042489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 136/276] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:37.043210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a4c4-31bc-4363-879a-d5c21d065486 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:37.053642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ecae1-8319-44bf-acb2-386f5a607b6f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.070522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:37.096615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae144b0-3dae-49ba-9625-750fd95b328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.098071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae144b0-3dae-49ba-9625-750fd95b328c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.098531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae144b0-3dae-49ba-9625-750fd95b328c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.098938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae144b0-3dae-49ba-9625-750fd95b328c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.100270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae144b0-3dae-49ba-9625-750fd95b328c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.101914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae144b0-3dae-49ba-9625-750fd95b328c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.103787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 141/277] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:37.105084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784f1b-8e21-4b45-bf80-e98a14696f8f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.105511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784f1b-8e21-4b45-bf80-e98a14696f8f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.105926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8784f1b-8e21-4b45-bf80-e98a14696f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.123681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f8784f1b-8e21-4b45-bf80-e98a14696f8f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:37.124943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8784f1b-8e21-4b45-bf80-e98a14696f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:37.160216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6a4c4-31bc-4363-879a-d5c21d065486 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.192232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:37.198650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.199518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 142/278] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:37.199843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.200126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.200404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] PATH_INFO: `/v3/users/d59b71e00e104eeaa8b85be626c411ef` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.207203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784f1b-8e21-4b45-bf80-e98a14696f8f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:37.216695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] RBAC: Authorizing `identity:get_user(user_id=d59b71e00e104eeaa8b85be626c411ef)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.218759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.221292 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 137/279] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:37 2022] GET /identity/v3/users/d59b71e00e104eeaa8b85be626c411ef => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:37.222695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:37.321420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8784f1b-8e21-4b45-bf80-e98a14696f8f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.324505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea75e9-7673-47d4-8328-f142f70a9947 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.335632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:37.358474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.359405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.359687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.360143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.360857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.361192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.361992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.362269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.362402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.362564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.373103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:37.381170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:37.382083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:37.382886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 138/280] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:37.383535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:37.387129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 143/281] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:13:37 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:37.389444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:37.478363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:37.533518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58215f-f21b-432c-a4cb-ef635c0bf8ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.553701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7495d-6b88-4511-b7e8-d2624c697abe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.584398 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.585191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.585539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.585879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.588148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:37.588148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.589859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.601642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.602448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.602803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.603141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.604080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, user.id=d59b71e00e104eeaa8b85be626c411ef, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:37.604469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.605983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.610365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 144/282] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:37.611632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:37.612995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 139/283] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Jul 12 17:13:37 2022] GET /identity/v3/role_assignments?user.id=d59b71e00e104eeaa8b85be626c411ef&scope.system=all&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:37.657102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:37.744381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f5108-fe44-4627-8062-e4d0a772c672 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.782456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.783361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.783652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.783918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] PATH_INFO: `/v3/users/ed5b9aa3d97f42bc9819e5c94a936f30` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.785139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=ed5b9aa3d97f42bc9819e5c94a936f30)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.786629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.788310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 145/284] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:37 2022] GET /identity/v3/users/ed5b9aa3d97f42bc9819e5c94a936f30 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:37.794914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:37.900822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9a963-fc76-4077-bff7-e7bc651dffb5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:37.915141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:37.935678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf0b4d-06d8-47d7-b7e3-424af92e1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:37.936602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf0b4d-06d8-47d7-b7e3-424af92e1967 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:37.936884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf0b4d-06d8-47d7-b7e3-424af92e1967 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:37.937164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf0b4d-06d8-47d7-b7e3-424af92e1967 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:37.938402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf0b4d-06d8-47d7-b7e3-424af92e1967 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:37.939885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf0b4d-06d8-47d7-b7e3-424af92e1967 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:37.941938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 140/285] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:37 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:37.947629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:38.089485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:38.093254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122798a-2321-473e-aeab-566144848cd0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:38.141891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646b745-f574-4d94-b9b0-660e245d6f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:38.143081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b745-f574-4d94-b9b0-660e245d6f3b None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:38.143536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b745-f574-4d94-b9b0-660e245d6f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:38.143940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b745-f574-4d94-b9b0-660e245d6f3b None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/ed5b9aa3d97f42bc9819e5c94a936f30/roles/87bf93c8ec484d3595c777a437c6659b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:38.146056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b745-f574-4d94-b9b0-660e245d6f3b None admin] RBAC: Authorizing `identity:create_grant(project_id=ed608294e8234fb3af659f8ca022de2c, user_id=ed5b9aa3d97f42bc9819e5c94a936f30, role_id=87bf93c8ec484d3595c777a437c6659b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:38.147686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b745-f574-4d94-b9b0-660e245d6f3b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:38.174102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 146/286] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:13:37 2022] PUT /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c/users/ed5b9aa3d97f42bc9819e5c94a936f30/roles/87bf93c8ec484d3595c777a437c6659b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:38.175799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070b25-1447-4924-b544-68eb2d63d4f0 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:38.176210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070b25-1447-4924-b544-68eb2d63d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:38.176586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4070b25-1447-4924-b544-68eb2d63d4f0 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:38.178332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 141/287] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:38.184301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889860ef-603f-46b8-8d09-caf37fcd0d1c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:38.184577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889860ef-603f-46b8-8d09-caf37fcd0d1c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:38.184884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889860ef-603f-46b8-8d09-caf37fcd0d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:38.209532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-889860ef-603f-46b8-8d09-caf37fcd0d1c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:38.211189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-889860ef-603f-46b8-8d09-caf37fcd0d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:38.312553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 147/288] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:38.338228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070b25-1447-4924-b544-68eb2d63d4f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:38.449612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4070b25-1447-4924-b544-68eb2d63d4f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:38.484088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:38.485453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:38.485930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:38.486427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:38.497729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:38.506147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:38.507054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:38.507847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:38.510559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 142/289] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:38.517091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889860ef-603f-46b8-8d09-caf37fcd0d1c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:38.673382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:38.696173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889860ef-603f-46b8-8d09-caf37fcd0d1c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:38.743020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:38.743622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:38.743901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:38.744176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:38.744943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:38.745249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:38.746662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:38.761185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 148/290] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:38.767071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:38.830662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:38.896985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14142ca-63a8-4a1f-a83a-cb95d5be5a3f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:38.931937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:38.933614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:38.934089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:38.934585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] PATH_INFO: `/v3/users/d6ff15e9162f411b93ebfc04af28debf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:38.936025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] RBAC: Authorizing `identity:get_user(user_id=d6ff15e9162f411b93ebfc04af28debf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:38.937793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:38.939740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 143/291] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:38 2022] GET /identity/v3/users/d6ff15e9162f411b93ebfc04af28debf => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:38.945524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:39.110897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288b8c-7f37-4235-830e-2456dc7137e1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:39.165739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:39.166426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:39.166705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:39.166973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:39.192051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:39.259333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:39.260802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:39.370617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 149/292] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:39.379389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:39.518241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd720a6-ea43-459c-aa16-00a565ac2a31 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:39.531493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:39.568965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66775602-3c13-404a-bf5a-0613b44bd9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:39.569852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775602-3c13-404a-bf5a-0613b44bd9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:39.570131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775602-3c13-404a-bf5a-0613b44bd9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:39.570428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775602-3c13-404a-bf5a-0613b44bd9d2 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:39.571641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66775602-3c13-404a-bf5a-0613b44bd9d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:39.573091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66775602-3c13-404a-bf5a-0613b44bd9d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:39.580493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 144/293] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:39 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:39.586119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:39.651761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:39.717065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aed515-db17-4283-a10c-bb7c9ef27e7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:39.757676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056fd90-6296-40ba-ad96-3910bd06921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:39.758617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fd90-6296-40ba-ad96-3910bd06921d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:39.759031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fd90-6296-40ba-ad96-3910bd06921d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:39.759435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056fd90-6296-40ba-ad96-3910bd06921d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:39.760428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056fd90-6296-40ba-ad96-3910bd06921d None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=d6ff15e9162f411b93ebfc04af28debf) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:39.760874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056fd90-6296-40ba-ad96-3910bd06921d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:39.762484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056fd90-6296-40ba-ad96-3910bd06921d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:39.769132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 150/294] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:39 2022] GET /identity/v3/role_assignments?user.id=d6ff15e9162f411b93ebfc04af28debf&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:40.170139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d24c-7eab-4c26-bdff-b6db083b20bc None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.170739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d24c-7eab-4c26-bdff-b6db083b20bc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.171115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1d24c-7eab-4c26-bdff-b6db083b20bc None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.173387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 145/295] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:40.178644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa0f7-6245-47db-baca-84a9ce497e62 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.179506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa0f7-6245-47db-baca-84a9ce497e62 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.179988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fa0f7-6245-47db-baca-84a9ce497e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.198344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e17fa0f7-6245-47db-baca-84a9ce497e62 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:40.199858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e17fa0f7-6245-47db-baca-84a9ce497e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:40.214967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5721be-f9b4-4da1-aa33-55ad621bf975 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.215584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5721be-f9b4-4da1-aa33-55ad621bf975 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.216086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5721be-f9b4-4da1-aa33-55ad621bf975 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.218002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 146/296] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:40.223228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c11328-81e7-4351-9ba9-eae71977c2f3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.223779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c11328-81e7-4351-9ba9-eae71977c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.224246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c11328-81e7-4351-9ba9-eae71977c2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.246233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-55c11328-81e7-4351-9ba9-eae71977c2f3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:40.248279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-55c11328-81e7-4351-9ba9-eae71977c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:40.284512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 151/297] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:40.294306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5adc-d5ba-4162-be1f-d606789bd41d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.294752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5adc-d5ba-4162-be1f-d606789bd41d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.295450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5adc-d5ba-4162-be1f-d606789bd41d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.297612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 152/298] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:40.303692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9e0cc-145d-4ac9-9620-b0b188f2a0ed None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.304343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9e0cc-145d-4ac9-9620-b0b188f2a0ed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.304865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9e0cc-145d-4ac9-9620-b0b188f2a0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.323261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c7d9e0cc-145d-4ac9-9620-b0b188f2a0ed None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:40.324525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7d9e0cc-145d-4ac9-9620-b0b188f2a0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:40.329281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 147/299] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:40.331131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c11328-81e7-4351-9ba9-eae71977c2f3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:40.375758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:40.404286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 153/300] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:40.407187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9e0cc-145d-4ac9-9620-b0b188f2a0ed None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:40.448587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c11328-81e7-4351-9ba9-eae71977c2f3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:40.458332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:40.484911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:40.485728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.486010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.486305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.497033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:40.505445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:40.506514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:40.507289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:40.507888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 148/301] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:40.508375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:40.523555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9e0cc-145d-4ac9-9620-b0b188f2a0ed None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:40.563322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:40.564146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.564432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.565114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.578602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:40.587139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:40.588027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:40.588815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 154/302] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:40.589497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:40.618553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7bc33b-11df-40dd-be71-3c5a72b4e6e8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:40.625962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:40.651289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:40.652088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.652366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.652635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.653786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:40.655372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:40.660118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 149/303] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:40.660118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:40.694532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3e7b-4182-4617-ae9e-a75256c722d0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:40.695186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:40.729401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70816cc2-fc01-4484-91a0-b74bce879857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:40.730001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70816cc2-fc01-4484-91a0-b74bce879857 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.730305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70816cc2-fc01-4484-91a0-b74bce879857 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.730583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70816cc2-fc01-4484-91a0-b74bce879857 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.731350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70816cc2-fc01-4484-91a0-b74bce879857 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:40.731658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70816cc2-fc01-4484-91a0-b74bce879857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:40.733366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70816cc2-fc01-4484-91a0-b74bce879857 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:40.742598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 155/304] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:40.744117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93ef2c-a51a-4387-a208-e4c97e6c7d39 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.744377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93ef2c-a51a-4387-a208-e4c97e6c7d39 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.744654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93ef2c-a51a-4387-a208-e4c97e6c7d39 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.746076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 156/305] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:40.746710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93ef2c-a51a-4387-a208-e4c97e6c7d39 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:40.764327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd39de-06a0-430f-a2ac-d1a66660360b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:40.797440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da4853-e684-4c0c-b92d-4020b86faac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:40.798110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4853-e684-4c0c-b92d-4020b86faac4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.798428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4853-e684-4c0c-b92d-4020b86faac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.798705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da4853-e684-4c0c-b92d-4020b86faac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.799448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4853-e684-4c0c-b92d-4020b86faac4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:40.799755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4853-e684-4c0c-b92d-4020b86faac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:40.801136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da4853-e684-4c0c-b92d-4020b86faac4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:40.809264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 150/306] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:40.810484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387163c0-3eec-4c53-b70b-214780ec1251 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.810772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387163c0-3eec-4c53-b70b-214780ec1251 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.811046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387163c0-3eec-4c53-b70b-214780ec1251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.828479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-387163c0-3eec-4c53-b70b-214780ec1251 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:40.829707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-387163c0-3eec-4c53-b70b-214780ec1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:40.848989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:40.856674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93ef2c-a51a-4387-a208-e4c97e6c7d39 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:40.891883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:40.892557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:40.892836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:40.893108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:40.893793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:40.894556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 151/307] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:40.895293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:40.895393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387163c0-3eec-4c53-b70b-214780ec1251 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:40.922524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:40.924360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 157/308] 10.222.0.50 () {60 vars in 1134 bytes} [Tue Jul 12 17:13:40 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:40.925191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:41.003434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387163c0-3eec-4c53-b70b-214780ec1251 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.040023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.040931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.041212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.041482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] PATH_INFO: `/v3/users/d59b71e00e104eeaa8b85be626c411ef` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.042775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] RBAC: Authorizing `identity:get_user(user_id=d59b71e00e104eeaa8b85be626c411ef)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:41.044226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:41.046072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 152/309] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:40 2022] GET /identity/v3/users/d59b71e00e104eeaa8b85be626c411ef => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:41.046975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:41.056286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64527a64-c02c-4c75-adb4-fb19a4b7748f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.097187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.098383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.098770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.099874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] PATH_INFO: `/v3/users/8a0e32238c5944b89480e61a150137e4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.115769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] RBAC: Authorizing `identity:get_user(user_id=8a0e32238c5944b89480e61a150137e4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:41.118032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:41.120182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 158/310] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:40 2022] GET /identity/v3/users/8a0e32238c5944b89480e61a150137e4 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:41.120959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:41.140557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:41.163747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:41.172968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da69018-a257-4272-9411-5863967d00c6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.212270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.213080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.213368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.213645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.225008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:41.231752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d33a8-5b63-4f70-b83e-8dfd73facf5d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:41.232760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:41.233991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:41.234822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 153/311] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:41.235494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:41.276742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.277972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.278504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.279026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] PATH_INFO: `/v3/system/users/d59b71e00e104eeaa8b85be626c411ef/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.280894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d59b71e00e104eeaa8b85be626c411ef, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:41.282514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:41.298339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 159/312] 10.222.0.50 () {58 vars in 1334 bytes} [Tue Jul 12 17:13:41 2022] PUT /identity/v3/system/users/d59b71e00e104eeaa8b85be626c411ef/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:41.298339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:41.354674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64940b62-ff8e-4275-958e-de9ef960f784 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.402366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.403054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.403332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.403605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.404470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] RBAC: Adding query filter params (role.id=87bf93c8ec484d3595c777a437c6659b, user.id=8a0e32238c5944b89480e61a150137e4, scope.system=all) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:41.404781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:41.407322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:41.414873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 154/313] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Jul 12 17:13:41 2022] GET /identity/v3/role_assignments?user.id=8a0e32238c5944b89480e61a150137e4&scope.system=all&role.id=87bf93c8ec484d3595c777a437c6659b => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:41.443373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae1ed8-3082-4254-89df-342125f123bb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.446530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:41.486261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.487053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.487336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.487611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.488376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:41.488681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:41.490103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:41.500812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 160/314] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:41.506573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:41.534206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:41.634821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333f996-8c0a-4f58-800a-c6bce9c483c7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.673688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.674713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.675000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.675282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] PATH_INFO: `/v3/users/ed5b9aa3d97f42bc9819e5c94a936f30` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.676514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ed5b9aa3d97f42bc9819e5c94a936f30)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:41.677993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:41.681141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 155/315] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:41 2022] GET /identity/v3/users/ed5b9aa3d97f42bc9819e5c94a936f30 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:41.687464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:41.794237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26862a-2e61-474a-8299-bdb8cc260b74 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:41.828704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:41.829370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:41.829653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:41.829927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:41.842637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:41.900791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:41.902310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:42.008514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 161/316] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:42.013836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:42.111539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:42.125239 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9f6ee-844a-4200-b75f-45f62d77b6f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:42.161564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cddc55-5a24-451b-91f7-c0ce5f3f6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:42.162847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddc55-5a24-451b-91f7-c0ce5f3f6930 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:42.163375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddc55-5a24-451b-91f7-c0ce5f3f6930 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:42.163869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddc55-5a24-451b-91f7-c0ce5f3f6930 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:42.165255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cddc55-5a24-451b-91f7-c0ce5f3f6930 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:42.166946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cddc55-5a24-451b-91f7-c0ce5f3f6930 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:42.169175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 156/317] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:42 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:42.174875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:42.222025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:42.281499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844b557-87b1-4df7-81de-b21afaa80d03 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:42.317714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdf3b9-cbf7-4b42-8abc-e6d44e35bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:42.318747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3b9-cbf7-4b42-8abc-e6d44e35bd79 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:42.319228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3b9-cbf7-4b42-8abc-e6d44e35bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:42.319720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3b9-cbf7-4b42-8abc-e6d44e35bd79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:42.320745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdf3b9-cbf7-4b42-8abc-e6d44e35bd79 None admin] RBAC: Adding query filter params (role.id=87bf93c8ec484d3595c777a437c6659b, scope.project.id=ed608294e8234fb3af659f8ca022de2c, user.id=ed5b9aa3d97f42bc9819e5c94a936f30) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:42.321249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdf3b9-cbf7-4b42-8abc-e6d44e35bd79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:42.322916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdf3b9-cbf7-4b42-8abc-e6d44e35bd79 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:42.329612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 162/318] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:13:42 2022] GET /identity/v3/role_assignments?user.id=ed5b9aa3d97f42bc9819e5c94a936f30&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=87bf93c8ec484d3595c777a437c6659b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:42.976862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178d737-79c8-4bb4-83c8-2d50f0d9a2af None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:42.977366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178d737-79c8-4bb4-83c8-2d50f0d9a2af None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:42.977366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178d737-79c8-4bb4-83c8-2d50f0d9a2af None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:42.978684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 157/319] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:42.984157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa8c1-889e-41b9-b9c6-00461195e1f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:42.984449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa8c1-889e-41b9-b9c6-00461195e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:42.984721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467aa8c1-889e-41b9-b9c6-00461195e1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.002224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-467aa8c1-889e-41b9-b9c6-00461195e1f7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:43.003434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-467aa8c1-889e-41b9-b9c6-00461195e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:43.073969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 163/320] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:43.097270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178d737-79c8-4bb4-83c8-2d50f0d9a2af None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:43.205471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178d737-79c8-4bb4-83c8-2d50f0d9a2af None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:43.238957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995b318-dec0-40e2-b423-0d8fbe55b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:43.239686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b318-dec0-40e2-b423-0d8fbe55b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.239954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b318-dec0-40e2-b423-0d8fbe55b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.240217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b318-dec0-40e2-b423-0d8fbe55b2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.241722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995b318-dec0-40e2-b423-0d8fbe55b2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:43.243220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995b318-dec0-40e2-b423-0d8fbe55b2e5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:43.245123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 158/321] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:13:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:43.250797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa8c1-889e-41b9-b9c6-00461195e1f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:43.285877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:43.355206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467aa8c1-889e-41b9-b9c6-00461195e1f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:43.390339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2a47-d362-47a6-b71b-0e126ee09f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:43.391058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2a47-d362-47a6-b71b-0e126ee09f49 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.391336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2a47-d362-47a6-b71b-0e126ee09f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.391599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2a47-d362-47a6-b71b-0e126ee09f49 None admin] PATH_INFO: `/v3/groups` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.392276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2a47-d362-47a6-b71b-0e126ee09f49 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:43.393712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2a47-d362-47a6-b71b-0e126ee09f49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:43.418338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 164/322] 10.222.0.50 () {60 vars in 1134 bytes} [Tue Jul 12 17:13:43 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:13:43.486329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f2ad-735d-4335-b868-2c8ff46860e9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.486586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f2ad-735d-4335-b868-2c8ff46860e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.486848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f2ad-735d-4335-b868-2c8ff46860e9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.488416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 159/323] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:43.494963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217de2-149e-4f0a-9476-03f10aed16c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.495130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217de2-149e-4f0a-9476-03f10aed16c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.495401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217de2-149e-4f0a-9476-03f10aed16c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.505835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad62bf5-0c78-4afb-99d7-a590a0277bd7 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.506090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad62bf5-0c78-4afb-99d7-a590a0277bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.506596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad62bf5-0c78-4afb-99d7-a590a0277bd7 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.508312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 160/324] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:43.514045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa3711-0149-42fd-b038-67ae9198c822 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.514219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-83217de2-149e-4f0a-9476-03f10aed16c2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:43.514325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa3711-0149-42fd-b038-67ae9198c822 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.514785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa3711-0149-42fd-b038-67ae9198c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.515348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-83217de2-149e-4f0a-9476-03f10aed16c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:43.532977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cffa3711-0149-42fd-b038-67ae9198c822 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:43.534203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cffa3711-0149-42fd-b038-67ae9198c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:43.553374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:43.595947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 165/325] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:43.615883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 161/326] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:43.622470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217de2-149e-4f0a-9476-03f10aed16c2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:43.639207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa3711-0149-42fd-b038-67ae9198c822 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:43.647207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:43.751475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217de2-149e-4f0a-9476-03f10aed16c2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:43.755306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa3711-0149-42fd-b038-67ae9198c822 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:43.791004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:43.791989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.792388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.792771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.794068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:43.795093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.795512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.796003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.806046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:43.809333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:43.815360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:43.816408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:43.817367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 166/327] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:43.820456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:43.821849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:43.823997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 162/328] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:43.825781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:43.829838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:43.852777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:43.940489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:43.952566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535f2e7-f034-41b8-bd7e-f1a8f6e384b1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:43.961870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e635-b6b6-4558-b9ff-382402dae2ac None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:43.994331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:43.995299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:43.995682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:43.996053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:43.997023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:43.997439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:43.999081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:44.005253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:44.006126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:44.006606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:44.007037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:44.008434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:44.008881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:44.010803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:44.012144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 163/329] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:44.019524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:44.021222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 167/330] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:44.026233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:44.106643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:44.128169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f5b80-fa70-4a38-aa81-9896aab28bbe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:44.152974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c92d9-a4a8-4e49-8420-425dd053be6a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:44.174768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:44.175995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:44.176470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:44.177421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] PATH_INFO: `/v3/users/8a0e32238c5944b89480e61a150137e4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:44.178925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] RBAC: Authorizing `identity:get_user(user_id=8a0e32238c5944b89480e61a150137e4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:44.180683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:44.183467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 164/331] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:44 2022] GET /identity/v3/users/8a0e32238c5944b89480e61a150137e4 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:44.190462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:44.202379 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:44.206258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:44.206571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:44.206850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] PATH_INFO: `/v3/users/d59b71e00e104eeaa8b85be626c411ef` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:44.208156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] RBAC: Authorizing `identity:get_user(user_id=d59b71e00e104eeaa8b85be626c411ef)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:44.209715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:44.214516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 168/332] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:44 2022] GET /identity/v3/users/d59b71e00e104eeaa8b85be626c411ef => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:44.220848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:44.243824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:44.333472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abad67a-dbcf-4b63-8d67-286ec5f89298 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:44.361009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596734-a374-475a-ae27-eadcc0592144 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:44.372488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670ca39-0d72-4a71-af89-18cb0512d63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:44.373578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670ca39-0d72-4a71-af89-18cb0512d63f None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:44.373852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670ca39-0d72-4a71-af89-18cb0512d63f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:44.374568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670ca39-0d72-4a71-af89-18cb0512d63f None admin] PATH_INFO: `/v3/system/users/8a0e32238c5944b89480e61a150137e4/roles/87bf93c8ec484d3595c777a437c6659b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:44.376206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670ca39-0d72-4a71-af89-18cb0512d63f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a0e32238c5944b89480e61a150137e4, role_id=87bf93c8ec484d3595c777a437c6659b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:44.377495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670ca39-0d72-4a71-af89-18cb0512d63f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:44.394491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 165/333] 10.222.0.50 () {58 vars in 1334 bytes} [Tue Jul 12 17:13:44 2022] PUT /identity/v3/system/users/8a0e32238c5944b89480e61a150137e4/roles/87bf93c8ec484d3595c777a437c6659b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:44.409679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe101b-d0fc-44e1-9052-7a0cae06316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:44.410772 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe101b-d0fc-44e1-9052-7a0cae06316f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:44.411278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe101b-d0fc-44e1-9052-7a0cae06316f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:44.411747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe101b-d0fc-44e1-9052-7a0cae06316f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:44.412801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe101b-d0fc-44e1-9052-7a0cae06316f None admin] RBAC: Adding query filter params (role.id=6b8632a7626e453996fdfe3232c95d66, user.id=d59b71e00e104eeaa8b85be626c411ef, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:44.413322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe101b-d0fc-44e1-9052-7a0cae06316f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:44.415038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe101b-d0fc-44e1-9052-7a0cae06316f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:44.435391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 169/334] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Jul 12 17:13:44 2022] GET /identity/v3/role_assignments?user.id=d59b71e00e104eeaa8b85be626c411ef&scope.system=all&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:45.955563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3a69-6f77-406c-bd9b-893cc96a0c18 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:45.956409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3a69-6f77-406c-bd9b-893cc96a0c18 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:45.956824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c3a69-6f77-406c-bd9b-893cc96a0c18 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:45.958640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 166/335] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:45.964970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275ff1-c053-4275-9f47-c2e6bc78f9d4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:45.965871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275ff1-c053-4275-9f47-c2e6bc78f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:45.966563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae275ff1-c053-4275-9f47-c2e6bc78f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:45.996125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ae275ff1-c053-4275-9f47-c2e6bc78f9d4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:45.997347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ae275ff1-c053-4275-9f47-c2e6bc78f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:46.092545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 170/336] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:46.140730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3a69-6f77-406c-bd9b-893cc96a0c18 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:46.156847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:46.302446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c3a69-6f77-406c-bd9b-893cc96a0c18 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:46.339485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:46.340295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:46.340576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:46.340853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:46.356898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:46.364682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:46.365549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:46.366762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:46.368874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 167/337] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:46.375542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275ff1-c053-4275-9f47-c2e6bc78f9d4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:46.377969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:46.543293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae275ff1-c053-4275-9f47-c2e6bc78f9d4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:46.601707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:46.601707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:46.601707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:46.601707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:46.602028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:46.602028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:46.602682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:46.612143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 171/338] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:46.618069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:46.740307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:46.799165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56be07-845b-484a-8f38-258ecace82b9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:46.840534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225004a-ebc1-49cf-bec4-afb90151c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:46.841201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225004a-ebc1-49cf-bec4-afb90151c94c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:46.841479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225004a-ebc1-49cf-bec4-afb90151c94c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:46.841759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225004a-ebc1-49cf-bec4-afb90151c94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:46.926182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225004a-ebc1-49cf-bec4-afb90151c94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:46.927601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225004a-ebc1-49cf-bec4-afb90151c94c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:47.002658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:47.042693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 168/339] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:47.051460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:47.147902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:47.169282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606c85b-b750-4f70-97e9-75adf94a9823 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.169620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606c85b-b750-4f70-97e9-75adf94a9823 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.169848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606c85b-b750-4f70-97e9-75adf94a9823 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.171725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 169/340] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:47.185764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157a3a-e111-453c-8a87-a994bd906260 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.185946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157a3a-e111-453c-8a87-a994bd906260 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.186608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157a3a-e111-453c-8a87-a994bd906260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.195434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dbe36-4591-441e-9f40-6d0f4568ea3e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:47.219420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7b157a3a-e111-453c-8a87-a994bd906260 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:47.220664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b157a3a-e111-453c-8a87-a994bd906260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:47.256577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7b36b-d025-4375-8fd2-290a2932788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:47.257482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b36b-d025-4375-8fd2-290a2932788d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.257760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b36b-d025-4375-8fd2-290a2932788d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.258028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7b36b-d025-4375-8fd2-290a2932788d None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.259271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7b36b-d025-4375-8fd2-290a2932788d None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:47.260921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7b36b-d025-4375-8fd2-290a2932788d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:47.263133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 172/341] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:47 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:47.264389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dbf2a-92e8-478f-a9dd-7bda0c1b2a01 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.264711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dbf2a-92e8-478f-a9dd-7bda0c1b2a01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.264985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dbf2a-92e8-478f-a9dd-7bda0c1b2a01 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.266430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 173/342] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:47.270918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dbf2a-92e8-478f-a9dd-7bda0c1b2a01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:47.341363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 170/343] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:47.344155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefb8c-c860-4366-a206-997c001f385a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.344155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefb8c-c860-4366-a206-997c001f385a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.344155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefb8c-c860-4366-a206-997c001f385a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.364489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1daefb8c-c860-4366-a206-997c001f385a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:47.365720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1daefb8c-c860-4366-a206-997c001f385a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:47.406042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dbf2a-92e8-478f-a9dd-7bda0c1b2a01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:47.439941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:47.445837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5739-444f-4721-8b84-9906c213ce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:47.447006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5739-444f-4721-8b84-9906c213ce0d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.447486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5739-444f-4721-8b84-9906c213ce0d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.447953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5739-444f-4721-8b84-9906c213ce0d None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.452550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 171/344] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:47.453980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13726d0-c87c-41c1-8df7-77c2f4b019bd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.454261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13726d0-c87c-41c1-8df7-77c2f4b019bd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.454554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13726d0-c87c-41c1-8df7-77c2f4b019bd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.460820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 172/345] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:47.461866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13726d0-c87c-41c1-8df7-77c2f4b019bd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:47.463824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe5739-444f-4721-8b84-9906c213ce0d None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:47.470116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe5739-444f-4721-8b84-9906c213ce0d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:47.475240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 174/346] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:47 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:47.476687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546c86-2776-4308-8e9e-a0b3a7bdda87 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.486421 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546c86-2776-4308-8e9e-a0b3a7bdda87 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.486945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11546c86-2776-4308-8e9e-a0b3a7bdda87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.511533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11546c86-2776-4308-8e9e-a0b3a7bdda87 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:47.512529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11546c86-2776-4308-8e9e-a0b3a7bdda87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:47.523464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:47.610336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 175/347] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:47.611230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546c86-2776-4308-8e9e-a0b3a7bdda87 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:47.620691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13726d0-c87c-41c1-8df7-77c2f4b019bd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:47.662480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:47.663465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.663741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.664005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.680440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:47.691109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:47.692000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:47.692780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 173/348] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:47.693425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:47.743891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11546c86-2776-4308-8e9e-a0b3a7bdda87 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:47.777308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:47.793972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d3a0b-054a-432b-9ba9-c39d967e80a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:47.794229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3a0b-054a-432b-9ba9-c39d967e80a5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.794560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3a0b-054a-432b-9ba9-c39d967e80a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.794830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3a0b-054a-432b-9ba9-c39d967e80a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.807988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d3a0b-054a-432b-9ba9-c39d967e80a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:47.809479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f05d3a0b-054a-432b-9ba9-c39d967e80a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:47.816604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:47.817621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:47.818583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 176/349] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:47.819270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7665c6-3806-4dc5-82e0-a0ba0a03f260 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.820146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7665c6-3806-4dc5-82e0-a0ba0a03f260 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.820146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7665c6-3806-4dc5-82e0-a0ba0a03f260 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.821864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 177/350] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:47.821864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7665c6-3806-4dc5-82e0-a0ba0a03f260 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:47.834952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de868e-26ab-4bae-8067-44708861ac02 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:47.881333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:47.882414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:47.882706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:47.883007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:47.883863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=6633d5e6015843a5a5c6444f58897578) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:47.884336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:47.886250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:47.893557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 174/351] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:47 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:47.894234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:47.971314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7665c6-3806-4dc5-82e0-a0ba0a03f260 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:48.023100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:48.023928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.024442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.024442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.040853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:48.049445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:48.050456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:48.051259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 178/352] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:48.052339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:48.059342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e2659-66ff-475e-86b0-5b56793d9edd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:48.110535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:48.117048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac684c8-1815-4816-83b8-76e3f32cc0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:48.117974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac684c8-1815-4816-83b8-76e3f32cc0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.118452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac684c8-1815-4816-83b8-76e3f32cc0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.118887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac684c8-1815-4816-83b8-76e3f32cc0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.120475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac684c8-1815-4816-83b8-76e3f32cc0d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:48.121245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac684c8-1815-4816-83b8-76e3f32cc0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:48.123577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac684c8-1815-4816-83b8-76e3f32cc0d9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:48.136069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 175/353] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:48.142958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e479fa-ee41-409c-b713-0a4b3d94372b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.143489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e479fa-ee41-409c-b713-0a4b3d94372b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.144245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e479fa-ee41-409c-b713-0a4b3d94372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.169839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e0e479fa-ee41-409c-b713-0a4b3d94372b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:48.173190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e0e479fa-ee41-409c-b713-0a4b3d94372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:48.182835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1847c1-965b-4de0-9ed9-c2dae7902236 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:48.188340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:48.229503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:48.230094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.230413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.230686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.231994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:48.232304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:48.234155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:48.245746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 179/354] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:48.246887 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:48.272251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 176/355] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:48.273165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e479fa-ee41-409c-b713-0a4b3d94372b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:48.412050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba808d-8d70-4aa0-9bd1-cb933f1609c2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:48.426080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:48.427840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e479fa-ee41-409c-b713-0a4b3d94372b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:48.464412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:48.465134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.465605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.465715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.466561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:48.469716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:48.469716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:48.473628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:48.474673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.474673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.474938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.478800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 180/356] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:48.479700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:48.500254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:48.578736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:48.580766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:48.616854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863a5e7-c0f9-4f17-8f17-8247ad44cf35 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:48.666358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d40db-3d0e-4523-8c2a-1e12ec81491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:48.667290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d40db-3d0e-4523-8c2a-1e12ec81491b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.667712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d40db-3d0e-4523-8c2a-1e12ec81491b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.668111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d40db-3d0e-4523-8c2a-1e12ec81491b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.723533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:48.725991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 177/357] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:48.727393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:48.766486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d40db-3d0e-4523-8c2a-1e12ec81491b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:48.768235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d40db-3d0e-4523-8c2a-1e12ec81491b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:48.791681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:48.872500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95a71d-db72-4201-b1a0-253d4a4c19ab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:48.901622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 181/358] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:48.903322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b873d-8cc7-476f-9922-c2955a0670c5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.903614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b873d-8cc7-476f-9922-c2955a0670c5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.903892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b873d-8cc7-476f-9922-c2955a0670c5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.905234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 182/359] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:48.906205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b873d-8cc7-476f-9922-c2955a0670c5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:48.930157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:48.931706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:48.931706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:48.931706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:48.943447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:48.951580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:48.952798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 17:13:48.953646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:48.954869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 178/360] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:48.954869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.012872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.043560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b873d-8cc7-476f-9922-c2955a0670c5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.075739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c759-9ad3-4b79-8516-c4f43084b70f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.079162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.088115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.088824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.089105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.089375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.114413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.115689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.116665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.117676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.118984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.120567 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.122692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 179/361] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:48 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:49.123560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.162719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.164185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.230403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40adcd8a-ccb1-4cdc-b530-aafeea70f1c6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.252016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.277360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d8ac9-ac98-4574-b045-c0d6d4c9f0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.278667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d8ac9-ac98-4574-b045-c0d6d4c9f0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.278988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d8ac9-ac98-4574-b045-c0d6d4c9f0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.279264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d8ac9-ac98-4574-b045-c0d6d4c9f0e7 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.280492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d8ac9-ac98-4574-b045-c0d6d4c9f0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.282057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d8ac9-ac98-4574-b045-c0d6d4c9f0e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.283977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 180/362] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:49.284972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532efb-6728-4728-b896-b7db5111c34d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.285256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532efb-6728-4728-b896-b7db5111c34d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.285526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532efb-6728-4728-b896-b7db5111c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.290846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 183/363] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:49.291821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.311345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-06532efb-6728-4728-b896-b7db5111c34d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:49.313959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-06532efb-6728-4728-b896-b7db5111c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:49.355197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.406108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 181/364] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:49.407271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532efb-6728-4728-b896-b7db5111c34d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.432141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209b2aa-8d29-41b9-ae48-3fb37f06d46c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.480831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.481532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.481812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.482084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.482972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:49.483430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.485449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.496615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 184/365] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:49.497956 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.534694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.538045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532efb-6728-4728-b896-b7db5111c34d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.592447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.592447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.592447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.592447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.594409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.597365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.599278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 182/366] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:49.602162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.628644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adda9b5-2abe-4ec5-b844-93d0a9f48db4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.650846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.673027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.673917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.674192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.674501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.675692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.677162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.679207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 185/367] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:49.680262 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.735308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7882-b5d7-43c2-b22f-70d88e03806c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.784277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.785613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.785902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.787660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.788417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.789886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.791883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 183/368] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:49.795512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.812271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.815760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319c358-550d-45ae-99f1-0b31b943e790 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.858756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.860038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.860549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.860829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.872143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:49.880290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:49.881386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:49.883461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:49.885835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 186/369] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:49.886811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:49.930563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4ca22-4e2b-4120-972b-121fd002a41a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:49.942260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:49.974437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:49.976097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:49.976382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:49.976654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] PATH_INFO: `/v3/users/8a0e32238c5944b89480e61a150137e4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:49.977855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=8a0e32238c5944b89480e61a150137e4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:49.979797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:49.981837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 184/370] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/users/8a0e32238c5944b89480e61a150137e4 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:49.986884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.007243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70488e-1f64-4bbb-bcaa-62249f2c0667 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.044228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.044912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.045181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.045451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.046941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=6633d5e6015843a5a5c6444f58897578) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:50.047273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:50.048732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:50.062321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 187/371] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=e2809f949125439eb6f73ac31122b973 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:50.062321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.090833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:50.107820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7202553-b7c9-4654-934a-9b62bc6ef4a7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.149612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.150223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.150541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.150819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.152296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=ed608294e8234fb3af659f8ca022de2c) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:50.152621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:50.154568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:50.161862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 185/372] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:49 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=e2809f949125439eb6f73ac31122b973 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:50.162637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.186281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab7de4-dd62-4dfc-9c2c-e513c7efb7f2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.230716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:50.231152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.232256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.232675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.233103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.234571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:50.237128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:50.239504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 188/373] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:50 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:50.240622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.315414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714adf8e-e0c5-494e-8a07-ca4754cb4b98 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.354773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d2f10-de7b-40ab-b30e-37c019cca925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.355787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2f10-de7b-40ab-b30e-37c019cca925 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.356255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2f10-de7b-40ab-b30e-37c019cca925 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.356710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2f10-de7b-40ab-b30e-37c019cca925 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.357633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d2f10-de7b-40ab-b30e-37c019cca925 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:50.358106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d2f10-de7b-40ab-b30e-37c019cca925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:50.360085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d2f10-de7b-40ab-b30e-37c019cca925 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:50.362454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:50.369337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf81db5-9638-44f0-89e4-2dc51b3ed3ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.370101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 186/374] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:50.371653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65c94-4785-42e0-86df-9185dad0e1d6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.372171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65c94-4785-42e0-86df-9185dad0e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.372665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb65c94-4785-42e0-86df-9185dad0e1d6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.375001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 187/375] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:50.376102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb65c94-4785-42e0-86df-9185dad0e1d6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.417610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.418200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.418512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.418788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.420081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] RBAC: Adding query filter params (role.id=87bf93c8ec484d3595c777a437c6659b, user.id=8a0e32238c5944b89480e61a150137e4, scope.system=all) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:50.420407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:50.422082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:50.438272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 189/376] 10.222.0.50 () {56 vars in 1308 bytes} [Tue Jul 12 17:13:50 2022] GET /identity/v3/role_assignments?user.id=8a0e32238c5944b89480e61a150137e4&scope.system=all&role.id=87bf93c8ec484d3595c777a437c6659b => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:50.439472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.488859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:50.491716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb65c94-4785-42e0-86df-9185dad0e1d6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.535666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c846558-ceb5-413e-986b-5bfb4b3b00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.536352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846558-ceb5-413e-986b-5bfb4b3b00d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.536635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846558-ceb5-413e-986b-5bfb4b3b00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.536909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c846558-ceb5-413e-986b-5bfb4b3b00d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.537761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c846558-ceb5-413e-986b-5bfb4b3b00d8 None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=ed608294e8234fb3af659f8ca022de2c) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:50.538074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c846558-ceb5-413e-986b-5bfb4b3b00d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:50.540325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c846558-ceb5-413e-986b-5bfb4b3b00d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:50.557546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 188/377] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:50 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:50.558983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e2759-dc66-4ffa-bbbb-07991f153e9e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.559272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e2759-dc66-4ffa-bbbb-07991f153e9e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.559549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e2759-dc66-4ffa-bbbb-07991f153e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.602444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300c7c3-48cd-4b8e-846d-60c5f31e0f87 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.603241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-985e2759-dc66-4ffa-bbbb-07991f153e9e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:50.604495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-985e2759-dc66-4ffa-bbbb-07991f153e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:50.678833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.679439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.679725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.679999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.729809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:50.740852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 189/378] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:50.769683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e2759-dc66-4ffa-bbbb-07991f153e9e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.808060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:50.809810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:50.919645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:50.925812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 190/379] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:50.929290 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e2759-dc66-4ffa-bbbb-07991f153e9e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:50.931413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:50.979100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:50.980162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:50.980929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:50.981370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:50.996599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:51.005715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:51.017160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:51.018091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:51.018935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 190/380] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:51.029921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:51.106348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0567-3df3-4255-b552-b03a5e3f154a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:51.201316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e7103-5e14-4bd4-a2f1-82da1aebef52 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:51.204406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:51.205300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:51.205577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:51.205845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] PATH_INFO: `/v3/projects/d7ba288325ae4db7b10fd752229e632e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:51.211046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=d7ba288325ae4db7b10fd752229e632e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:51.212519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:51.214501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 191/381] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:50 2022] GET /identity/v3/projects/d7ba288325ae4db7b10fd752229e632e => generated 344 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:51.223840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:51.266302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:51.266989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:51.267266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:51.267532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:51.268347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:51.268654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:51.273116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:51.289866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 191/382] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:51.306950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:51.334268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:51.372028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d642-5480-4758-a48e-273992f28ca1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:51.404487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:51.434653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:51.435538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:51.435816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:51.436088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] PATH_INFO: `/v3/groups/3dbd76770287407ba67ad3c7b0a2eaf6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:51.445091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] RBAC: Authorizing `identity:get_group(group_id=3dbd76770287407ba67ad3c7b0a2eaf6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:51.446603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:51.455483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 192/383] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:51 2022] GET /identity/v3/groups/3dbd76770287407ba67ad3c7b0a2eaf6 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:51.458054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:51.491958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1721745-6d5b-4775-89cd-2c3e8c0fc46e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:51.575418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:51.576776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:51.577281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:51.577708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:51.579580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:51.581048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:51.582827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 192/384] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:51 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:51.591637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:51.658544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8d862-cec9-4643-b5f5-0ad3f8c0b46b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:51.708577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:51.709475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:51.709914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:51.710364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:51.711428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] RBAC: Adding query filter params (group.id=3dbd76770287407ba67ad3c7b0a2eaf6, role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=d7ba288325ae4db7b10fd752229e632e) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:51.711900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:51.713638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:51.722889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 193/385] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:51 2022] GET /identity/v3/role_assignments?group.id=3dbd76770287407ba67ad3c7b0a2eaf6&scope.project.id=d7ba288325ae4db7b10fd752229e632e&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:51.723395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:51.740451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf887dd-8eee-459e-85c4-6876d9765230 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:51.779263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bda5a7-1067-436e-a3f2-bd211d6d4491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:51.780543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda5a7-1067-436e-a3f2-bd211d6d4491 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:51.781061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda5a7-1067-436e-a3f2-bd211d6d4491 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:51.781510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bda5a7-1067-436e-a3f2-bd211d6d4491 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:51.787368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bda5a7-1067-436e-a3f2-bd211d6d4491 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:51.789124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bda5a7-1067-436e-a3f2-bd211d6d4491 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:51.791756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 193/386] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:51 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:51.797712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:51.878678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:51.935032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65fc6f-4be6-4922-bcaf-c14acbc092a4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:51.971603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087620d-4867-4168-ba46-61ac0b31e547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:51.972770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087620d-4867-4168-ba46-61ac0b31e547 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:51.973189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087620d-4867-4168-ba46-61ac0b31e547 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:51.973601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087620d-4867-4168-ba46-61ac0b31e547 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578/groups/88ed7521f273437f856b6cf1fcb385ee/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:51.975805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087620d-4867-4168-ba46-61ac0b31e547 None admin] RBAC: Authorizing `identity:create_grant(project_id=6633d5e6015843a5a5c6444f58897578, group_id=88ed7521f273437f856b6cf1fcb385ee, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:51.977441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087620d-4867-4168-ba46-61ac0b31e547 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:51.997233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 194/387] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Jul 12 17:13:51 2022] PUT /identity/v3/projects/6633d5e6015843a5a5c6444f58897578/groups/88ed7521f273437f856b6cf1fcb385ee/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:52.589073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5c35-3372-46de-a5cb-85dba17d8a9a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:52.589589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5c35-3372-46de-a5cb-85dba17d8a9a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:52.589662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5c35-3372-46de-a5cb-85dba17d8a9a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:52.591446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 194/388] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:52.594562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f03d-ccce-43f4-81dd-4b3f0f676a2e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:52.595431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f03d-ccce-43f4-81dd-4b3f0f676a2e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:52.595711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f03d-ccce-43f4-81dd-4b3f0f676a2e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:52.597111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 195/389] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:52.598902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500fc46-0abf-46f7-be98-ab36bd4d6162 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:52.598902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500fc46-0abf-46f7-be98-ab36bd4d6162 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:52.599060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500fc46-0abf-46f7-be98-ab36bd4d6162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:52.604363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2d6b-f784-4c75-96ea-60f70bedb760 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:52.604658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2d6b-f784-4c75-96ea-60f70bedb760 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:52.604936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2d6b-f784-4c75-96ea-60f70bedb760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:52.627548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0500fc46-0abf-46f7-be98-ab36bd4d6162 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:52.628759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0500fc46-0abf-46f7-be98-ab36bd4d6162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:52.631510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-918d2d6b-f784-4c75-96ea-60f70bedb760 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:52.632681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-918d2d6b-f784-4c75-96ea-60f70bedb760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:52.751658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 196/390] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:52.751941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 195/391] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:52.792095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d2d6b-f784-4c75-96ea-60f70bedb760 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:52.806228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500fc46-0abf-46f7-be98-ab36bd4d6162 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:52.859500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:52.894770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:52.915061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500fc46-0abf-46f7-be98-ab36bd4d6162 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:52.952002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:52.953249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:52.953675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:52.954090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:52.965394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:52.974959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:52.976122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:52.977139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:52.979687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 196/392] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:52.985246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.065902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d2d6b-f784-4c75-96ea-60f70bedb760 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.142617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.144837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.145268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.146669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.160383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccfaa7-8ca1-4d81-9a0f-5e6d80eaa2fd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.175585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:53.192703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:53.194151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:53.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:53.200054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 197/393] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:53.207264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.221947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34e91-79d1-47d6-8e04-65b21dd8a3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.222939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34e91-79d1-47d6-8e04-65b21dd8a3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.223395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34e91-79d1-47d6-8e04-65b21dd8a3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.223840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34e91-79d1-47d6-8e04-65b21dd8a3f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.224771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc34e91-79d1-47d6-8e04-65b21dd8a3f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:53.225275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc34e91-79d1-47d6-8e04-65b21dd8a3f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:53.227360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc34e91-79d1-47d6-8e04-65b21dd8a3f0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:53.236948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 197/394] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:53.238949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bb315-26ef-40f1-8ca5-2c634b32d38b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.239436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bb315-26ef-40f1-8ca5-2c634b32d38b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.239928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bb315-26ef-40f1-8ca5-2c634b32d38b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.241737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 198/395] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:53.243310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bb315-26ef-40f1-8ca5-2c634b32d38b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.283564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:53.341886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:53.350469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85fee5-411a-42be-82c3-2926488aa6f7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.369734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bb315-26ef-40f1-8ca5-2c634b32d38b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.387143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e186de-d97b-4587-8cdd-d9847c538e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.387842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e186de-d97b-4587-8cdd-d9847c538e9b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.388123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e186de-d97b-4587-8cdd-d9847c538e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.388394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e186de-d97b-4587-8cdd-d9847c538e9b None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.389165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e186de-d97b-4587-8cdd-d9847c538e9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:53.389498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e186de-d97b-4587-8cdd-d9847c538e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:53.390915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e186de-d97b-4587-8cdd-d9847c538e9b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:53.399925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 198/396] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:53.401246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319bf1-17f5-419c-b550-1c597e644715 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.401540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319bf1-17f5-419c-b550-1c597e644715 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.401816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81319bf1-17f5-419c-b550-1c597e644715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.422834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.423043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-81319bf1-17f5-419c-b550-1c597e644715 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:53.424225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-81319bf1-17f5-419c-b550-1c597e644715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:53.424525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.425001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.425500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.428280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:53.429941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:53.432178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 199/397] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:53 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:53.433143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.512874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 199/398] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:53.514074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319bf1-17f5-419c-b550-1c597e644715 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.517118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:53.552113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4faa14-c629-426e-9764-f3a57bc9c461 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.588526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.589493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.590018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.590110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.591332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:53.592948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:53.595561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 200/399] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:53 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:53.596487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.617609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:53.632760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81319bf1-17f5-419c-b550-1c597e644715 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.668686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.669929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.670481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.671010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.672438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:53.674082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:53.680938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 200/400] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:53 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:53.682013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.707617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42935168-45a6-44e1-adf8-6e6f5ceee890 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.745101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.745890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.746176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.746509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.755179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:53.759614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:53.769255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:53.770203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:53.771036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 201/401] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:53.771692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.796144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8697f-7d32-4cfd-a9bf-fc091d29d660 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.832683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.833920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.834436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.834903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.836316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:53.837965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:53.840245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 201/402] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:53 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:53.841200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.867897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:53.882915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462cc61-95ae-41d3-8d47-18c3b94c3f74 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:53.922067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:53.923217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:53.923397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:53.923642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c/groups/88ed7521f273437f856b6cf1fcb385ee/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:53.926032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] RBAC: Authorizing `identity:create_grant(project_id=ed608294e8234fb3af659f8ca022de2c, group_id=88ed7521f273437f856b6cf1fcb385ee, role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:53.927681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:53.950330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 202/403] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Jul 12 17:13:53 2022] PUT /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c/groups/88ed7521f273437f856b6cf1fcb385ee/roles/e2809f949125439eb6f73ac31122b973 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:53.950330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:53.965976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863d3f-295c-43a4-992c-1005f3f980f0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.064255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:54.064964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.065250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.065523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.066316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:54.069860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:54.071776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:54.084979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 202/404] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:54.098327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:54.098574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:54.157842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45055e-2be6-41fb-b02b-f432bf751d5d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.201004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8c668-03ec-4d7a-b6dd-71c18f23577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:54.202843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c668-03ec-4d7a-b6dd-71c18f23577a None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.203142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c668-03ec-4d7a-b6dd-71c18f23577a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.203420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c668-03ec-4d7a-b6dd-71c18f23577a None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578/groups/88ed7521f273437f856b6cf1fcb385ee/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.206356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8c668-03ec-4d7a-b6dd-71c18f23577a None admin] RBAC: Authorizing `identity:create_grant(project_id=6633d5e6015843a5a5c6444f58897578, group_id=88ed7521f273437f856b6cf1fcb385ee, role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:54.208143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8c668-03ec-4d7a-b6dd-71c18f23577a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:54.215512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:54.230719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 203/405] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Jul 12 17:13:53 2022] PUT /identity/v3/projects/6633d5e6015843a5a5c6444f58897578/groups/88ed7521f273437f856b6cf1fcb385ee/roles/e2809f949125439eb6f73ac31122b973 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:54.232307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49254bd4-da52-4272-8dd4-840d98c5c599 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.232936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49254bd4-da52-4272-8dd4-840d98c5c599 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.233335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49254bd4-da52-4272-8dd4-840d98c5c599 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.236572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 204/406] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:54.240183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c03f7e-92b5-4a24-8643-1dfb0c971f6f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.262360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151a7f-b4f7-40d2-8970-1568922aad2f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.262360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151a7f-b4f7-40d2-8970-1568922aad2f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.262360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da151a7f-b4f7-40d2-8970-1568922aad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.304603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-da151a7f-b4f7-40d2-8970-1568922aad2f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:54.307865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-da151a7f-b4f7-40d2-8970-1568922aad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:54.329877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:54.332564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.333009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.333589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.336545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:54.338423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:54.341051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 203/407] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:54 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:54.351614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:54.438537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 205/408] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:54.442338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07705-8e84-43ce-9b7b-d759c9a5ef31 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.442338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07705-8e84-43ce-9b7b-d759c9a5ef31 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.442563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e07705-8e84-43ce-9b7b-d759c9a5ef31 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.445416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 206/409] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:54.451592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ec41a-bee6-479f-91b5-986d8f8a7323 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.452089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ec41a-bee6-479f-91b5-986d8f8a7323 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.452573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ec41a-bee6-479f-91b5-986d8f8a7323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.474408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c98ec41a-bee6-479f-91b5-986d8f8a7323 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:54.475578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c98ec41a-bee6-479f-91b5-986d8f8a7323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:54.477725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbead0cc-fda3-4ec1-90a2-5b6d4b4da908 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.524079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:54.525123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.525412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.525688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.527128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:54.528665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:54.529977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:54.531726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 204/410] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:54 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:54.532933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:54.555844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 207/411] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:54.557072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ec41a-bee6-479f-91b5-986d8f8a7323 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:54.564288 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:54.672595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ec41a-bee6-479f-91b5-986d8f8a7323 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.681240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad735c3-1631-4544-9dbf-dc47b888bfa4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.707830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:54.708748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.709106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.709450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c/groups/88ed7521f273437f856b6cf1fcb385ee/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.712905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] RBAC: Authorizing `identity:create_grant(project_id=ed608294e8234fb3af659f8ca022de2c, group_id=88ed7521f273437f856b6cf1fcb385ee, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:54.714477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:54.732031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 208/412] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Jul 12 17:13:54 2022] PUT /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c/groups/88ed7521f273437f856b6cf1fcb385ee/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:54.733470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:54.736516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:54.737410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.737690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.738579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.754723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:54.763412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:54.764697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:54.765690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:54.770578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 205/413] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:54.772025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:54.813699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:54.914086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971aa0e7-67b8-456b-bcbf-0331a5a4be4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.947677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:54.961298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:54.962050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:54.962359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:54.962638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:54.971364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa592c-b17e-489f-8f04-ddfe806ae8b6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:54.978928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:54.989129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:54.990003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:54.990926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 209/414] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:54.998578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:55.017616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:55.020149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:55.020433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:55.020704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:55.021832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:55.022135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:55.023668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:55.040421 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 206/415] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:55.046161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:55.180137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:55.182959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8604367-9151-46ad-8da9-e5977eba8dac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:55.195062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ab824-ce3d-4693-a79d-adddd2c07c49 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:55.218995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:55.219749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:55.220133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:55.220505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:55.221391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] RBAC: Adding query filter params (name=member) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:55.221797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:55.224545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:55.232470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 210/416] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:55.238429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:55.283784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:55.284688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:55.284977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:55.285254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] PATH_INFO: `/v3/groups/3dbd76770287407ba67ad3c7b0a2eaf6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:55.286484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] RBAC: Authorizing `identity:get_group(group_id=3dbd76770287407ba67ad3c7b0a2eaf6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:55.287964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:55.289949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 207/417] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:55 2022] GET /identity/v3/groups/3dbd76770287407ba67ad3c7b0a2eaf6 => generated 229 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:55.295149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:55.334657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:55.358490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6121d-1747-4085-8817-cb223e627cca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:55.427939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:55.428605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:55.428889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:55.429161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:55.467077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1e64d-3370-4cfd-9e70-71d2890d1494 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:55.504029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:55.505321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:55.505604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:55.505881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] PATH_INFO: `/v3/projects/d7ba288325ae4db7b10fd752229e632e` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:55.507492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] RBAC: Authorizing `identity:get_project(project_id=d7ba288325ae4db7b10fd752229e632e)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:55.509004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:55.511247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 208/418] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:55 2022] GET /identity/v3/projects/d7ba288325ae4db7b10fd752229e632e => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:55.518478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:55.524294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:55.592346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:55.594105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:55.684189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:55.725414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc94ce1-d9fe-4211-84ef-f9eec86c9810 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:55.781040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:55.781942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:55.782227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:55.782533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] PATH_INFO: `/v3/projects/d7ba288325ae4db7b10fd752229e632e/groups/3dbd76770287407ba67ad3c7b0a2eaf6/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:55.783606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 211/419] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:55.789891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:55.794682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7ba288325ae4db7b10fd752229e632e, group_id=3dbd76770287407ba67ad3c7b0a2eaf6, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:55.796597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:55.834272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 209/420] 10.222.0.50 () {58 vars in 1442 bytes} [Tue Jul 12 17:13:55 2022] PUT /identity/v3/projects/d7ba288325ae4db7b10fd752229e632e/groups/3dbd76770287407ba67ad3c7b0a2eaf6/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:13:55.871230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:55.930402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf532b41-6cd8-4548-a02a-20db3904cec7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:55.992735 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fff84-6f89-4f07-984d-33c32580e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:55.993636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fff84-6f89-4f07-984d-33c32580e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:55.993919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fff84-6f89-4f07-984d-33c32580e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:55.994193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fff84-6f89-4f07-984d-33c32580e8c4 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:55.995493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fff84-6f89-4f07-984d-33c32580e8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:55.996962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fff84-6f89-4f07-984d-33c32580e8c4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:55.999385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 212/421] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:55 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:56.005400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:56.194945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebf4d2-604c-476f-91b5-d1aeb856dab7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:56.244133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf506-96d9-4526-8788-0a19f1058f12 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.244758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf506-96d9-4526-8788-0a19f1058f12 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.245218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebf506-96d9-4526-8788-0a19f1058f12 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.247083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 213/422] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:13:56.250025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:56.251035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.251512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.251703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.252896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:56.253301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38745eb7-29d0-4ffb-b3a9-0d2d8f03fac0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.253768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38745eb7-29d0-4ffb-b3a9-0d2d8f03fac0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.254222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38745eb7-29d0-4ffb-b3a9-0d2d8f03fac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.254415 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:56.256356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 210/423] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:56 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:56.263249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:56.276225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:56.278418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-38745eb7-29d0-4ffb-b3a9-0d2d8f03fac0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:56.279818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38745eb7-29d0-4ffb-b3a9-0d2d8f03fac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:56.403463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 214/424] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:56.427935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359f94-0cfd-4742-869b-60ba168431aa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:56.438389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38745eb7-29d0-4ffb-b3a9-0d2d8f03fac0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:56.463759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:56.464347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.464629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.464902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.465745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=6633d5e6015843a5a5c6444f58897578) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:56.466116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:56.467806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:56.474343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 211/425] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:56 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 611 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:56.558722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:56.611219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38745eb7-29d0-4ffb-b3a9-0d2d8f03fac0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:56.657297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deed999-f665-49e9-851e-d7105536685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:56.658134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed999-f665-49e9-851e-d7105536685e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.658559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed999-f665-49e9-851e-d7105536685e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.658837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deed999-f665-49e9-851e-d7105536685e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.669937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deed999-f665-49e9-851e-d7105536685e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6deed999-f665-49e9-851e-d7105536685e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:56.678474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:56.679356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:56.680132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 215/426] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:56.687096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:56.766743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:56.797914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f3802-680b-4403-8946-c6c3174021cc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:56.819298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5c13-252a-48c6-9fda-f4b4da6e236f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.819833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5c13-252a-48c6-9fda-f4b4da6e236f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.819833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5c13-252a-48c6-9fda-f4b4da6e236f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.821211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 216/427] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:56.826347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517359cf-4774-4102-8893-acc39c8a13fa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.826634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517359cf-4774-4102-8893-acc39c8a13fa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.826947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517359cf-4774-4102-8893-acc39c8a13fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.844952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:56.845643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:56.845929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:56.846200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:56.847045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:56.847354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:56.848815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:56.851204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-517359cf-4774-4102-8893-acc39c8a13fa None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:56.852790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-517359cf-4774-4102-8893-acc39c8a13fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:56.859100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 212/428] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:56.868795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:56.940664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 217/429] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:56.972875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517359cf-4774-4102-8893-acc39c8a13fa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:56.994677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7935c23-7498-420b-be66-540c1f8c26b3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.029425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.030098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.030587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.030879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.034681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.035972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.105341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517359cf-4774-4102-8893-acc39c8a13fa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.125403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:57.127135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:57.159972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e4d3c-cb3a-417c-9161-28854da56564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.160800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e4d3c-cb3a-417c-9161-28854da56564 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.161102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e4d3c-cb3a-417c-9161-28854da56564 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.161347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e4d3c-cb3a-417c-9161-28854da56564 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.178856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e4d3c-cb3a-417c-9161-28854da56564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-777e4d3c-cb3a-417c-9161-28854da56564 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:57.188777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:57.189718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 218/430] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:13:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:13:57.190545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9949-8eac-4bf7-9662-96f70a36f914 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.191261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9949-8eac-4bf7-9662-96f70a36f914 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.191261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b9949-8eac-4bf7-9662-96f70a36f914 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.192794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 219/431] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:57.197791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46b58-ff19-465a-ae9b-5016cc211dd6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.198084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46b58-ff19-465a-ae9b-5016cc211dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.198410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46b58-ff19-465a-ae9b-5016cc211dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.221994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1ee46b58-ff19-465a-ae9b-5016cc211dd6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:57.223275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ee46b58-ff19-465a-ae9b-5016cc211dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:57.248676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 213/432] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:57.249433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.288098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.302333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 220/433] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:13:57.311210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46b58-ff19-465a-ae9b-5016cc211dd6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.363253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e431e8-28a9-48bc-b696-70cd6988b1ef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.363490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.399376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.400058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.400339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.400612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.401359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:57.401665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:57.403093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:57.411492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 214/434] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:57.412311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.429946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46b58-ff19-465a-ae9b-5016cc211dd6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.467658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.468673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.468953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.469224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.470440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:57.471906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:57.473614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 221/435] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:57.478232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.517090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.525106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c9380-8135-4d44-89b0-dd11841c5c4a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.560984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.561882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.562400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.562572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.573243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:57.583272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:57.584356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 17:13:57.585343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:57.589358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1d6d-baa4-4dce-a980-739fa67180f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.589466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 215/436] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:57.590268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.599449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.627090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.627850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.628190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.628531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.702816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:57.703303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd7c19-c429-4495-ab9c-9f20aa512e4c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.704287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:57.739395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.740270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.740557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.740835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.742421 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:57.743874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:57.745524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 216/437] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:57.746310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.778976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.815411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 222/438] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:57.816656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.828846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:57.869890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7d255-b3b1-44d0-be7c-43e75ad014c0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.906677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.907605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.908026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.908441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.909357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] RBAC: Adding query filter params (name=member) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:57.909801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:57.911347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:57.924678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 217/439] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:57.925443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a37f6-4e94-4e78-aec5-a581aabc1794 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:57.925901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:57.960918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:57.961587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:57.961871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:57.962145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:57.963011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=ed608294e8234fb3af659f8ca022de2c) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:57.963327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:57.964768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:57.971978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 223/440] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=e2809f949125439eb6f73ac31122b973 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:57.971978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.033208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.051868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eea4a9-5464-4427-b0b0-25ee83bd3126 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.073912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.094198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.095371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.095718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.096168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] PATH_INFO: `/v3/projects/6633d5e6015843a5a5c6444f58897578` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.097526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] RBAC: Authorizing `identity:get_project(project_id=6633d5e6015843a5a5c6444f58897578)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.099139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.105529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 218/441] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/projects/6633d5e6015843a5a5c6444f58897578 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:58.107093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.117404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f74f91-a1b4-4eec-a395-990755b54ddf None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.165277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e25dd-03d6-48fd-ab1e-4366d6dac88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.166851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e25dd-03d6-48fd-ab1e-4366d6dac88e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.167333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e25dd-03d6-48fd-ab1e-4366d6dac88e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.167899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e25dd-03d6-48fd-ab1e-4366d6dac88e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.239303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186ded0-2939-453f-82f1-3cf9ab37b426 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.249708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e25dd-03d6-48fd-ab1e-4366d6dac88e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.251328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e25dd-03d6-48fd-ab1e-4366d6dac88e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.278722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651f5e7-5105-45a5-b4b1-bd25b11a0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.279600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f5e7-5105-45a5-b4b1-bd25b11a0368 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.279884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f5e7-5105-45a5-b4b1-bd25b11a0368 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.280270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651f5e7-5105-45a5-b4b1-bd25b11a0368 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.281737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651f5e7-5105-45a5-b4b1-bd25b11a0368 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.283289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651f5e7-5105-45a5-b4b1-bd25b11a0368 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.284958 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 219/442] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:58.286135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb6df-f82b-4471-8792-823a4236d6f8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.286446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb6df-f82b-4471-8792-823a4236d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.286725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb6df-f82b-4471-8792-823a4236d6f8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.290326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 220/443] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:13:58.290530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedb6df-f82b-4471-8792-823a4236d6f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.316787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.323152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.353418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 224/444] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:13:58.354725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2503-f3e7-4bb6-bcc5-ac526d7379d7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.355027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2503-f3e7-4bb6-bcc5-ac526d7379d7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.355297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a2503-f3e7-4bb6-bcc5-ac526d7379d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.371995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3e8a2503-f3e7-4bb6-bcc5-ac526d7379d7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:13:58.373190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3e8a2503-f3e7-4bb6-bcc5-ac526d7379d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:13:58.396330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedb6df-f82b-4471-8792-823a4236d6f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.429949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.430670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.430945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.431219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.432059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=6633d5e6015843a5a5c6444f58897578) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:58.432373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.433833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.438011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 225/445] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:13:58.438677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2503-f3e7-4bb6-bcc5-ac526d7379d7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.448017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 221/446] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=6633d5e6015843a5a5c6444f58897578&role.id=e2809f949125439eb6f73ac31122b973 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:58.464217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.572486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.574733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a2503-f3e7-4bb6-bcc5-ac526d7379d7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.578992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.591908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd676bb-5a33-408e-8ce0-8f74fbf2a428 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.628889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.629693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.629957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.630226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] PATH_INFO: `/v3/projects/ed608294e8234fb3af659f8ca022de2c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.631758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] RBAC: Authorizing `identity:get_project(project_id=ed608294e8234fb3af659f8ca022de2c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.632904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.634625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 226/447] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/projects/ed608294e8234fb3af659f8ca022de2c => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:58.641389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.642719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.643474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.643750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.644019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.657898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:13:58.666609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:13:58.667504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:13:58.668316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 222/448] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:13:58.673768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.759404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af5de3-e717-4cdd-bdf6-a7a735ec9f31 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.798753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.799628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.799907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.800172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] PATH_INFO: `/v3/groups/88ed7521f273437f856b6cf1fcb385ee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.801362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] RBAC: Authorizing `identity:get_group(group_id=88ed7521f273437f856b6cf1fcb385ee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.802860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.805253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 227/449] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/groups/88ed7521f273437f856b6cf1fcb385ee => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:58.810524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.813441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b7228-4423-45ab-b735-9db3491de271 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.848648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.849327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.849608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.849877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.850657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:58.850962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.852337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.852981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.860792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 223/450] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:58.866822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:58.877760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:58.913236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f8103-a7b9-48f9-b590-40654b9566b6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.964492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:58.965186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:58.965460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:58.965732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:58.966589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] RBAC: Adding query filter params (group.id=88ed7521f273437f856b6cf1fcb385ee, role.id=6b8632a7626e453996fdfe3232c95d66, scope.project.id=ed608294e8234fb3af659f8ca022de2c) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:58.966904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:58.968576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:58.974114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33187e3b-6462-4ef7-a30d-7b0fdf9f09e4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:58.974998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 228/451] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/role_assignments?group.id=88ed7521f273437f856b6cf1fcb385ee&scope.project.id=ed608294e8234fb3af659f8ca022de2c&role.id=6b8632a7626e453996fdfe3232c95d66 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:13:59.016674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:59.017354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:59.017640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:59.017915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:59.097075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:59.098595 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:59.110277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:59.207271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 224/452] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 17:13:59.213156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:59.325363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6b333-4898-4e01-8933-e3595afd1c5c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:59.326948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:59.361481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:59.362397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:59.362680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:59.362953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] PATH_INFO: `/v3/projects/d7ba288325ae4db7b10fd752229e632e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:59.364220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] RBAC: Authorizing `identity:get_project(project_id=d7ba288325ae4db7b10fd752229e632e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:59.365665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:59.367784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 229/453] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:13:59 2022] GET /identity/v3/projects/d7ba288325ae4db7b10fd752229e632e => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:59.373461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:59.476145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2e730-b464-4abf-8cad-e29e55692a80 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:59.485297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:13:59.511226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951499bb-d060-4d70-bc78-bce703ad141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:59.512098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951499bb-d060-4d70-bc78-bce703ad141b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:59.512380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951499bb-d060-4d70-bc78-bce703ad141b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:59.512651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951499bb-d060-4d70-bc78-bce703ad141b None admin] PATH_INFO: `/v3/groups/3dbd76770287407ba67ad3c7b0a2eaf6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:59.513943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951499bb-d060-4d70-bc78-bce703ad141b None admin] RBAC: Authorizing `identity:get_group(group_id=3dbd76770287407ba67ad3c7b0a2eaf6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:59.515540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951499bb-d060-4d70-bc78-bce703ad141b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:59.517183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 225/454] 10.222.0.50 () {56 vars in 1180 bytes} [Tue Jul 12 17:13:59 2022] GET /identity/v3/groups/3dbd76770287407ba67ad3c7b0a2eaf6 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:13:59.526529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:13:59.634997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af4fb7-6e1e-4959-a7ce-e1e8d00504eb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:13:59.673911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305fa92-3f75-4837-aa4c-c1f88a72a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:13:59.674586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305fa92-3f75-4837-aa4c-c1f88a72a9eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:13:59.674862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305fa92-3f75-4837-aa4c-c1f88a72a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:13:59.675138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305fa92-3f75-4837-aa4c-c1f88a72a9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:13:59.675959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305fa92-3f75-4837-aa4c-c1f88a72a9eb None admin] RBAC: Adding query filter params (group.id=3dbd76770287407ba67ad3c7b0a2eaf6, role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=d7ba288325ae4db7b10fd752229e632e) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:13:59.676269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305fa92-3f75-4837-aa4c-c1f88a72a9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:13:59.677696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305fa92-3f75-4837-aa4c-c1f88a72a9eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:13:59.683572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 230/455] 10.222.0.50 () {56 vars in 1376 bytes} [Tue Jul 12 17:13:59 2022] GET /identity/v3/role_assignments?group.id=3dbd76770287407ba67ad3c7b0a2eaf6&scope.project.id=d7ba288325ae4db7b10fd752229e632e&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:02.238880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79fc3-8f67-4226-9dc4-78816cde3a22 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.239436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79fc3-8f67-4226-9dc4-78816cde3a22 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.239436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79fc3-8f67-4226-9dc4-78816cde3a22 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.240825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 226/456] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:02.260009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a05db2-aa38-4207-93f9-548debb2d74a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.260445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a05db2-aa38-4207-93f9-548debb2d74a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.260621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a05db2-aa38-4207-93f9-548debb2d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.287354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-66a05db2-aa38-4207-93f9-548debb2d74a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:02.288881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-66a05db2-aa38-4207-93f9-548debb2d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:02.326314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:02.384670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 231/457] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:02.394484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a3eb9-74b8-459f-8d7b-364d7cfb990b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.394780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a3eb9-74b8-459f-8d7b-364d7cfb990b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.395065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a3eb9-74b8-459f-8d7b-364d7cfb990b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.396705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 227/458] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:02.401861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca02c-ca35-4982-8128-8fe48b51041d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.402422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca02c-ca35-4982-8128-8fe48b51041d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.402895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca02c-ca35-4982-8128-8fe48b51041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.421062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-64fca02c-ca35-4982-8128-8fe48b51041d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:02.422596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a3eb9-74b8-459f-8d7b-364d7cfb990b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:02.422875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-64fca02c-ca35-4982-8128-8fe48b51041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:02.517016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 232/459] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:02.522961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bd655-9a55-4a40-b3ef-ffb70cd24005 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.523165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bd655-9a55-4a40-b3ef-ffb70cd24005 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.523386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bd655-9a55-4a40-b3ef-ffb70cd24005 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.526722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 233/460] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:02.531215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df05fb-7a01-4ff2-a81e-2c66129b69f0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.531504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df05fb-7a01-4ff2-a81e-2c66129b69f0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.531781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df05fb-7a01-4ff2-a81e-2c66129b69f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.558491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-09df05fb-7a01-4ff2-a81e-2c66129b69f0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:02.560707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-09df05fb-7a01-4ff2-a81e-2c66129b69f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:02.599168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a3eb9-74b8-459f-8d7b-364d7cfb990b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:02.642806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:02.643761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.644045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.644318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.648368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 234/461] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:02.649424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df05fb-7a01-4ff2-a81e-2c66129b69f0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:02.660633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:02.662526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:02.676962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:02.683373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:02.688586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:02.689449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:02.689449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:02.689449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:02.689449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:02.689449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 228/462] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:02.692255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:02.728183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:02.785553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df05fb-7a01-4ff2-a81e-2c66129b69f0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:02.821303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e71de0-4fb1-439e-b45c-cce18ce99946 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:02.829354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:02.830485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.830990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.831471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.842685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:02.844453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:02.863576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:02.864394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:02.864683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:02.864953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:02.865580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:02.866753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:02.867603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:02.867603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:02.867603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:02.867603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:02.872907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 235/463] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:02.872907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:02.885661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:02.887616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:02.912654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:02.913553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:02.914818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:02.914818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:02.914818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:02.914818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:02.918898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 229/464] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:02.920763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:02.973011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:03.000563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766682a-d5df-44d5-a5c8-fde1b985a46a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.012129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:03.035509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.036242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.036467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.036561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5b76-6da8-47b1-b0a0-2c0a6fa6db34 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.036747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.037457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:03.037758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.039175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.051864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 236/465] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:03.052706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:03.078274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927ecee-91f3-4a79-a505-d1fe9aa214ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.078980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927ecee-91f3-4a79-a505-d1fe9aa214ae None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.079266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927ecee-91f3-4a79-a505-d1fe9aa214ae None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.079540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927ecee-91f3-4a79-a505-d1fe9aa214ae None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.080269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927ecee-91f3-4a79-a505-d1fe9aa214ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:03.080578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927ecee-91f3-4a79-a505-d1fe9aa214ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.081972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927ecee-91f3-4a79-a505-d1fe9aa214ae None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.100001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 230/466] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:03.101310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dccbd9-14c1-43d8-9efb-88361ec6570a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.101596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dccbd9-14c1-43d8-9efb-88361ec6570a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.101874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dccbd9-14c1-43d8-9efb-88361ec6570a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.103274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 231/467] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:03.103810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dccbd9-14c1-43d8-9efb-88361ec6570a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:03.168494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949615b3-84ed-47b4-a844-e60c9f67d472 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.205315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.206069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.206384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.206660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.207381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:03.207686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.209076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.209927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dccbd9-14c1-43d8-9efb-88361ec6570a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.211548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:03.223186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 237/468] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:03.224101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:03.253680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23a914-9cab-4aa2-aa5a-34d8f17a9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.254571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a914-9cab-4aa2-aa5a-34d8f17a9da3 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.254951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a914-9cab-4aa2-aa5a-34d8f17a9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.255320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23a914-9cab-4aa2-aa5a-34d8f17a9da3 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.256071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23a914-9cab-4aa2-aa5a-34d8f17a9da3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.257706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23a914-9cab-4aa2-aa5a-34d8f17a9da3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.268769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:03.289962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 232/469] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:14:03 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:03.289962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4019-1ede-4837-bd50-b294a9e4d857 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.289962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4019-1ede-4837-bd50-b294a9e4d857 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.289962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4019-1ede-4837-bd50-b294a9e4d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.304680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-257f4019-1ede-4837-bd50-b294a9e4d857 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:03.306149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-257f4019-1ede-4837-bd50-b294a9e4d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:03.360597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6ea5b-9e8f-437a-8ae1-0a460da8d867 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.403461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.404429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.404800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.405944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.406657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.408404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.418565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 233/470] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:03.419567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4019-1ede-4837-bd50-b294a9e4d857 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:03.447079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 238/471] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:14:03 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:03.448047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:03.547255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:03.588119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4019-1ede-4837-bd50-b294a9e4d857 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.610021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71164f-8447-4000-9e86-e4b40c881c1d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.625546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:03.641031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fbbc9-15ed-4d6d-95a8-d2c2e5eb63d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.641730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fbbc9-15ed-4d6d-95a8-d2c2e5eb63d6 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.642030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fbbc9-15ed-4d6d-95a8-d2c2e5eb63d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.642339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fbbc9-15ed-4d6d-95a8-d2c2e5eb63d6 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.643037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fbbc9-15ed-4d6d-95a8-d2c2e5eb63d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.644491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fbbc9-15ed-4d6d-95a8-d2c2e5eb63d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.657698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.658514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.658884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.659053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.668512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 234/472] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:14:03 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:03.671474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64f0c2-ffb0-4f55-bac6-f8db1ce142e3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.672017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64f0c2-ffb0-4f55-bac6-f8db1ce142e3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.672302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.672735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64f0c2-ffb0-4f55-bac6-f8db1ce142e3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.673922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.678724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 235/473] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:03.682926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e368-d734-4edc-a699-2dd7eb76e40b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.683256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e368-d734-4edc-a699-2dd7eb76e40b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.683528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4e368-d734-4edc-a699-2dd7eb76e40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:03.702646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:03.703541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:03.704405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:03.704405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:03.704405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:03.704405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:03.704623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5dd4e368-d734-4edc-a699-2dd7eb76e40b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:03.705166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5dd4e368-d734-4edc-a699-2dd7eb76e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:03.706815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 239/474] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:03.715681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:03.803466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 236/475] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:03.842210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5260b51-a7c3-40ae-8e18-8b6d1128fb94 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:03.844904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:03.851871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e368-d734-4edc-a699-2dd7eb76e40b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:03.882566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:03.883256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:03.883661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:03.883937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:03.884688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:03.884992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:03.886538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:03.901269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 240/476] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:03.912320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:04.038711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a21cc-f636-40a4-93ad-729f1fd8873e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:04.039734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4e368-d734-4edc-a699-2dd7eb76e40b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:04.060168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:04.095778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:04.096475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:04.096755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:04.097028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:04.097801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:04.099240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:04.100398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:04.102048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:04.103447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:04.104364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:04.105981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:04.109442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:04.109635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 17:14:04.109635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 17:14:04.109635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [parameters: {'id': '7974bc1229e64e8683f7db500e768d54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 17:14:04.109635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jul 12 17:14:04.129779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 17:14:04.130814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 17:14:04.136968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 17:14:04.137896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 17:14:04.138799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 17:14:04.139899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'id': '7974bc1229e64e8683f7db500e768d54', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:04.140711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 17:14:04.141578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:04.144312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 237/477] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Jul 12 17:14:03 2022] POST /identity/v3/roles => generated 144 bytes in 280 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:04.145439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:04.146221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 241/478] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:14:03 2022] POST /identity/v3/users => generated 249 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:14:04.270248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3d977-63c1-4f36-8ee8-91bd067d8f8f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:04.308476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f784b-5a56-416c-9a0e-ac026d446740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:04.309311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f784b-5a56-416c-9a0e-ac026d446740 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:04.309638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f784b-5a56-416c-9a0e-ac026d446740 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:04.309911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f784b-5a56-416c-9a0e-ac026d446740 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:04.322750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f784b-5a56-416c-9a0e-ac026d446740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-155f784b-5a56-416c-9a0e-ac026d446740 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:04.331046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:04.332119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:04.333292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 238/479] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:04.340775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:04.364318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:04.448475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440281e-b813-463f-9f65-d72fd1272364 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:04.489061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad8628-5251-4633-a708-e7c0e982ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:04.489736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8628-5251-4633-a708-e7c0e982ba96 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:04.490016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8628-5251-4633-a708-e7c0e982ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:04.490313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8628-5251-4633-a708-e7c0e982ba96 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:04.491437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad8628-5251-4633-a708-e7c0e982ba96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:04.491742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad8628-5251-4633-a708-e7c0e982ba96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:04.493140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad8628-5251-4633-a708-e7c0e982ba96 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:04.503317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 242/480] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:05.815494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473ac2-a9f7-4e01-8cfc-32525585b545 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:05.816504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473ac2-a9f7-4e01-8cfc-32525585b545 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:05.816986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473ac2-a9f7-4e01-8cfc-32525585b545 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:05.818862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 239/481] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:05.824646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e927cd-74fb-4fd5-aa48-f397888b34df None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:05.825492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e927cd-74fb-4fd5-aa48-f397888b34df None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:05.825964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e927cd-74fb-4fd5-aa48-f397888b34df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:05.851269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-57e927cd-74fb-4fd5-aa48-f397888b34df None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:05.852768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-57e927cd-74fb-4fd5-aa48-f397888b34df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:05.963169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 243/482] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:14:05.993919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28473ac2-a9f7-4e01-8cfc-32525585b545 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.047432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:06.141104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ef6bf-8935-4d18-86c2-e35e4c66b671 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.141730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ef6bf-8935-4d18-86c2-e35e4c66b671 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.142206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ef6bf-8935-4d18-86c2-e35e4c66b671 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.143961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 244/483] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:14:06.152439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caff46-2f23-476f-8cd5-c6b54635b5d5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.152439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caff46-2f23-476f-8cd5-c6b54635b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.152439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77caff46-2f23-476f-8cd5-c6b54635b5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.180198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-77caff46-2f23-476f-8cd5-c6b54635b5d5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:06.181773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-77caff46-2f23-476f-8cd5-c6b54635b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:06.183588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28473ac2-a9f7-4e01-8cfc-32525585b545 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.206753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:06.258418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14289de-93eb-4e0c-b14c-66e24f465d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:06.259644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14289de-93eb-4e0c-b14c-66e24f465d08 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.262147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14289de-93eb-4e0c-b14c-66e24f465d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.262703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14289de-93eb-4e0c-b14c-66e24f465d08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.288444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14289de-93eb-4e0c-b14c-66e24f465d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c14289de-93eb-4e0c-b14c-66e24f465d08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:06.297147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:06.298056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:06.298909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:06.307001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 240/484] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:06.308338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88325-b808-42ef-821e-a287a9437202 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.308624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88325-b808-42ef-821e-a287a9437202 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.308932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c88325-b808-42ef-821e-a287a9437202 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.310457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 241/485] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:06.316094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db81303-0597-439e-94f2-6f21346def8a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.316441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db81303-0597-439e-94f2-6f21346def8a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.316645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db81303-0597-439e-94f2-6f21346def8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.318751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 245/486] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:06.320240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caff46-2f23-476f-8cd5-c6b54635b5d5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.345925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1db81303-0597-439e-94f2-6f21346def8a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:06.347211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1db81303-0597-439e-94f2-6f21346def8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:06.426831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 242/487] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:14:06.427634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db81303-0597-439e-94f2-6f21346def8a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.456147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:06.463268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77caff46-2f23-476f-8cd5-c6b54635b5d5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.509640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:06.511433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.511943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.512422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.513846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:06.514446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:06.516773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:06.529321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 246/488] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:06.530581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.535050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:06.545203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db81303-0597-439e-94f2-6f21346def8a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.592800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:06.593619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.593947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.594224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.607707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:06.618495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:06.619426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:06.620216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:06.624582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 243/489] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:06.625460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.652005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acab48-67a0-412c-a099-f7eca18f018b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.688440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:06.689578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.690056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.690570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.701883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:06.710091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:06.710995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:06.711789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:06.714504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 247/490] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:06.715731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.724048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:06.742662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21974e-bc02-4487-bcc6-f188d2432b1f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.777464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:06.778193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.778500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.778770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.783860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:06.790724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:06.792172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:06.810409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:06.811438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:06.812274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:06.812274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:06.812274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:06.812274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:06.812274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 244/491] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:06.813022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.829810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353eaf4-f08a-428e-a6ae-c9bc052ecc4a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.867340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:06.868024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.868308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.868582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.869344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:06.869659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:06.871101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:06.884832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 248/492] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:06.884832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:06.934414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c7d36-441e-4997-9528-2ee690d93fb8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.971189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1b436-fd76-4422-a95f-00ded95c8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:06.972106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1b436-fd76-4422-a95f-00ded95c8e71 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.972520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1b436-fd76-4422-a95f-00ded95c8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.972921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1b436-fd76-4422-a95f-00ded95c8e71 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.973912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1b436-fd76-4422-a95f-00ded95c8e71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:06.974377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1b436-fd76-4422-a95f-00ded95c8e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:06.976003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1b436-fd76-4422-a95f-00ded95c8e71 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:06.982157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:06.985933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bce1d-9665-40f9-8853-28b8f27fa96c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:06.990391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 245/493] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:06.992109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27b3c-a6b0-452e-b98b-6579ec7fe032 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:06.992391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27b3c-a6b0-452e-b98b-6579ec7fe032 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:06.992658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27b3c-a6b0-452e-b98b-6579ec7fe032 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:06.998214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 246/494] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:06.998214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa27b3c-a6b0-452e-b98b-6579ec7fe032 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.018400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.029305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.030264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.030578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.030853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.031593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:07.031911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.033296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.050388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 249/495] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:07.050388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.111538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa27b3c-a6b0-452e-b98b-6579ec7fe032 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.149266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79eab3-ae7b-42ae-82c5-d043404e78ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.150399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79eab3-ae7b-42ae-82c5-d043404e78ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.150678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79eab3-ae7b-42ae-82c5-d043404e78ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.150944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79eab3-ae7b-42ae-82c5-d043404e78ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.151186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f00f8e-ceae-4b44-a5e4-21cc7983cbd7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.161386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79eab3-ae7b-42ae-82c5-d043404e78ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.162881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79eab3-ae7b-42ae-82c5-d043404e78ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5c79eab3-ae7b-42ae-82c5-d043404e78ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:07.180254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:07.181292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:07.182209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:07.182209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:07.182209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:07.182209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:07.182209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 247/496] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:07.182658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223f62-a199-4876-ab26-7b1942df5d84 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.182938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223f62-a199-4876-ab26-7b1942df5d84 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.183212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223f62-a199-4876-ab26-7b1942df5d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.187219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.188198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.189265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.189571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.198948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cb223f62-a199-4876-ab26-7b1942df5d84 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:07.200132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cb223f62-a199-4876-ab26-7b1942df5d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:07.200376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.202037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:07.219534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:07.220383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:07.221298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:07.221298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:07.221298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:07.221298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:07.221298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 250/497] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:07.221578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.253781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.272518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.276207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 248/498] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:07.277645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26f1d-349b-44a8-ad8b-2a92e9690561 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.277925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26f1d-349b-44a8-ad8b-2a92e9690561 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.278204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26f1d-349b-44a8-ad8b-2a92e9690561 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.279665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 249/499] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:07.281058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26f1d-349b-44a8-ad8b-2a92e9690561 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.337960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb41ffd-380b-428c-974f-caf38d4b8507 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.374834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.375722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.376011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.376286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.383374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.384850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.396981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26f1d-349b-44a8-ad8b-2a92e9690561 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:07.400347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:07.401236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:07.402382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 251/500] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:07.403332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.431953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6709b-4af8-413d-a60b-334c2e1bc6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.432634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6709b-4af8-413d-a60b-334c2e1bc6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.432914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6709b-4af8-413d-a60b-334c2e1bc6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.433192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6709b-4af8-413d-a60b-334c2e1bc6c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.433917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6709b-4af8-413d-a60b-334c2e1bc6c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:07.434221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6709b-4af8-413d-a60b-334c2e1bc6c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.435652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6709b-4af8-413d-a60b-334c2e1bc6c9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.447207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 250/501] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:07.448399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bfc1d-71fd-4a46-b36c-5099fa49718e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.448686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bfc1d-71fd-4a46-b36c-5099fa49718e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.448959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bfc1d-71fd-4a46-b36c-5099fa49718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.465201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-967bfc1d-71fd-4a46-b36c-5099fa49718e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:07.466427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-967bfc1d-71fd-4a46-b36c-5099fa49718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:07.501500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.503527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.507122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4ab2-a731-4849-8b58-fa7659504170 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.534921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 251/502] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:07.535788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bfc1d-71fd-4a46-b36c-5099fa49718e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.545314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.546384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.546736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.547078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.547868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:07.548239 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.549718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.563954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 252/503] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:07.564774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.653565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bfc1d-71fd-4a46-b36c-5099fa49718e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.678938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37300db-833b-4e9c-8984-90aba1efc37d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.690158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.691001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.691283 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.691544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.701509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:07.709648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:07.710764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:07.711605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 252/504] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:07.712451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.713986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.714687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.715045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.715319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.716154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:07.716788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.718274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.747634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.756155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 253/505] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:07.756940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.775573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.822669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbad032-7e7e-4688-ac30-ffd935157101 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.856864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.857069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823d0f1-c14c-470f-9290-61348d7b209b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:07.857680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.857991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.858333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.866197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.867700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:07.884280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:07.885275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:07.886150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 253/506] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:07.886749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.895393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:07.896224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:07.896508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:07.896777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:07.907092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:07.908571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:07.926034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:07.926936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:07.927778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:07.927778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:07.927778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:07.927778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:07.927778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 254/507] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:07.928108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:07.980530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:07.991205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ad95d-a272-4f1b-8ad8-d79e69070f1b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.000054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.026817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.027869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.028144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.028413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.035089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360dadb-6932-4f49-9157-6476ddb0f500 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.036156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.037611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:08.052100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:08.053044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:08.053931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 254/508] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:08.054527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.069644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.070339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.070622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.070892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.071641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:08.071950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.073340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.081851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 255/509] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:08.082661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.158255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34aedd-6e5d-429f-96f1-ebdcd3b3aa9d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.182148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25990bef-58c0-40db-a982-0f56377973c0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.190378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.191028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.191353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.191583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.211721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.212566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.218557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.219236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.219525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.219798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.220668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:08.220975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.222434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.239496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 256/510] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:08.240404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.265318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.266841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.338167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef87da-d758-44b2-b34a-e347b2aa7290 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.362046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 255/511] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:08.363050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.373702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.374539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.374846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.375115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.375840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:08.376145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.377549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.388643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 257/512] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:08.389659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.419129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.438144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.467039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8cc27-59d3-410e-ab12-2a527819ab9e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.488021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d222c-0181-442c-953a-8b6326bf8c24 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.501202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.501875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.502213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.502516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.503353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:08.503662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.505130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.521804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.522648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.522932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.523204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.534104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.535633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.540975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 256/513] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:08.541833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:08.552966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:08.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:08.554983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:08.554983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:08.554983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:08.554983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:08.554983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 258/514] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:08.554983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.646080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be2de2-a3ab-4745-b840-22e8bc33647a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.653440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.657183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef338ec0-3f44-4c8c-8c24-26be810b640a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.657549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.691218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.691876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.692160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.692435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.697965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.698874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.699220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.699583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.714023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.715563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:08.733798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:08.734817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:08.735657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:08.735657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:08.735657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:08.735657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:08.735657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 259/515] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:08.735926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.768929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.770441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.845668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f7534-b564-4676-85a2-45348fdd7b4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:08.876769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 257/516] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:08.877877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.889161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:08.889899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:08.890180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:08.890490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:08.891206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:08.892661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:08.893001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:08.912435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 260/517] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:14:08 2022] POST /identity/v3/users => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:08.913242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:08.925289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.007494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc5946-ae40-459f-8665-e7f90e2ab6e0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.033673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0558d-a3ff-42a6-9c0e-4bf1e498d458 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.047647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.048433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.048713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.048983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.069425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.070087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.070404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.070683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.071415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:09.072329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.073068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.088204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 261/518] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:09.089108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.132447 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.133836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.146799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.163740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.198756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0b69c-d8d3-41b5-a203-4855744fb961 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.234332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.235119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.235401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.235817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.236447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:09.236699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.238075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.249796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 258/519] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:09.249796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.258986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 262/520] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:09.258986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.363991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974d8b4-3294-4b26-8270-21a46ee26204 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.368701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dd04a-1cb4-4660-bdff-6cb994099b4f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.376332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.402660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.403707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.403837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.404299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.404299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.413293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.414478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.414934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.415379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.416053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.417861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.428559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.430030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:09.440358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:09.441174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:09.442026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:09.442026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:09.442026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:09.442026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:09.445860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:09.446949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 17:14:09.447842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:09.448333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 259/521] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:09.448333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.451935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 263/522] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:09.452812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.567186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54da9aa-7e10-45ad-a0ad-3fae489667c5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.591345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c95759-b090-477a-80a6-568fbb767671 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.611809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.612633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.612909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.613192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.624923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.626410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.637513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.638346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.638631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.638904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:09.643405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:09.644253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:09.645232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:09.645232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:09.645232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:09.645232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:09.649343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 260/523] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:09.650190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.650856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.652357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.667141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:09.677935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:09.679404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:09.680246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 264/524] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:09.680716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.752299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.783247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7549470-41f2-4047-b1fb-a44a1bdfc449 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.807547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ded9d-0357-4c0b-9d92-2c84d862a3cb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.817576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.818250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.818590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.818843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.819562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:09.819864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.821249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.837433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 261/525] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:09.837433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.848094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.848858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.849149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.849411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.850259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:09.850601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.852026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:09.870652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 265/526] 10.222.0.50 () {56 vars in 1139 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:09.871576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:09.921384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.948428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07b098-6035-4dda-bf46-4fd794180a7e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.973649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820972f-39c3-40b4-9d6a-4415c3286aee None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:09.981148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:09.984718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:09.985412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:09.985693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:09.986028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:09.986790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:09.987126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:09.988517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.006345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 262/527] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:10.006345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.020234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.020910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.021198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.021468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.022265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:10.022597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.024038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.047227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 266/528] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:10.047227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.121815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a72a-9b4e-4861-b625-22d5085f51b5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.156213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7644c93-f476-4f8f-91a0-780a9378354c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.161469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.162317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.162593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.162864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.164840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:10.171599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.172970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:10.187496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:10.188373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:10.189215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 263/529] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:10.189695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.200738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.201724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.202893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.203354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.250254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:10.293000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.294599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.314905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb90f80-cc7f-49a7-b0fb-613433c9c5cf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.349356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.350171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.350495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.350749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.357638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.359243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:10.380312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:10.381351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:10.382410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:10.386380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 264/530] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:10.387281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.406347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 267/531] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:10.407461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.450442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:10.480874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:10.500864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c706116-06ab-4bb7-a27f-9ae072e957b2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.519947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a8f5f-a225-4948-8179-7d9c7d95f723 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.541241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.542031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.542334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.542616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.543457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5253b3eec6ae45f3bca9369107c4d93a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:10.543769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.545222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.551552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 265/532] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/role_assignments?user.id=5253b3eec6ae45f3bca9369107c4d93a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:10.552375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.570012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.571160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.571699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.572173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.573291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:10.573828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.575662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.595386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 268/533] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:10.596188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.718217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e212c-64e6-4b27-9ad1-f8177b04ff52 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.725711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe9f6f-f565-474a-9414-25c35f911805 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.743607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:10.757797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:10.768232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.769391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.769539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.769963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.770437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.770545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.770895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.771267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.772372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:10.772799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.775390 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.784775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.786800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.806326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 266/534] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:10.806326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:10.810418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:10.811565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:10.812489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:10.812489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:10.812489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:10.812489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:10.816852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 269/535] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:10.818079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.939089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7f298-f607-47a0-b5e8-abe837ce3fb1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.943375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e5897-7597-4d23-8984-ce745c504791 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:10.980203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d648153-1e4e-49bc-b8c1-96382fcee435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.981573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648153-1e4e-49bc-b8c1-96382fcee435 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.982034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648153-1e4e-49bc-b8c1-96382fcee435 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.982276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:10.982717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d648153-1e4e-49bc-b8c1-96382fcee435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.983345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.983640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.983976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.984355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648153-1e4e-49bc-b8c1-96382fcee435 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=c30dd51dbbb245a485be48fce34295e8) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:10.984819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=7724df01ff1444a09a751bb54dabc222) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:10.985091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648153-1e4e-49bc-b8c1-96382fcee435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.985210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:10.986594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.987191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d648153-1e4e-49bc-b8c1-96382fcee435 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:10.997796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 267/536] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/role_assignments?user.id=7724df01ff1444a09a751bb54dabc222&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:10.998093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 270/537] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/role_assignments?user.id=c30dd51dbbb245a485be48fce34295e8&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:10.998187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:10.998393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396c0e8-f2e2-44c4-849e-98cdf2dd9dc9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:10.998393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396c0e8-f2e2-44c4-849e-98cdf2dd9dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:10.998393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396c0e8-f2e2-44c4-849e-98cdf2dd9dc9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:10.998393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 271/538] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:11.008115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cb028-9cc7-4e42-a753-32339019706d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:11.008345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cb028-9cc7-4e42-a753-32339019706d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:11.008612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7cb028-9cc7-4e42-a753-32339019706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:11.044130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b7cb028-9cc7-4e42-a753-32339019706d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:11.045377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b7cb028-9cc7-4e42-a753-32339019706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:11.093582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:11.126224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:11.197280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 272/539] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:11.211404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc138f36-41c0-4fae-817f-d18856b99487 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:11.224034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cb028-9cc7-4e42-a753-32339019706d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:11.251740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:11.252612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:11.252901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:11.253178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:11.254068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:11.254409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:11.256361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:11.284737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 268/540] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:11.291359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:11.394954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7cb028-9cc7-4e42-a753-32339019706d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:11.438005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:11.438847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:11.439130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:11.439403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:11.450298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:11.455955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee443f-c515-406e-863d-47c56e753d36 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:11.458176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:11.459081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:11.459865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 273/541] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:11.466272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:11.467456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:11.502892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:11.536983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:11.537799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:11.538080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:11.538376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:11.555028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:11.556803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:11.580841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:11.581776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:11.582672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 269/542] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:11.595446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:11.597260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad543b7-dc81-4a33-8b34-7d7a4560721c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:11.642230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:11.643415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:11.643937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:11.644397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:11.645343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:11.645838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:11.647785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:11.661034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 274/543] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:11.666695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:11.787901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b593f-2638-4fef-b388-4f8bc7e7bb8a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:11.802900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:11.810617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cdae7-237f-4729-8b37-4190e52986b5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:11.851874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:11.853665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:11.854584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:11.855137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:11.856046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:11.856548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:11.857748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:11.858363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:11.859678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:11.861619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:11.863442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:11.882695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:11.884532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:11.890266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 270/544] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:11.896287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:11.920133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:11.921417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:11.922376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:11.922376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:11.922376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:11.922376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:11.929217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 275/545] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:11.932871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:11.950033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:12.079028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d755ec-56dc-4bbb-832b-c8b64c7f87c8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:12.115197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58681-b506-4740-8c0a-5f5ed22b0a20 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:12.134833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:12.135508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:12.135791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:12.136067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:12.136801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:12.137109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:12.138524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:12.165485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 276/546] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:12.166756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:12.181281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:12.186150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:12.186967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:12.187292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:12.187567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:12.188411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=164446c4b65e4043a492dc626a571e81) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:12.188724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:12.190438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:12.202351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 271/547] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:11 2022] GET /identity/v3/role_assignments?user.id=164446c4b65e4043a492dc626a571e81&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:12.325685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80783862-9bf3-4bab-84aa-c026405fbd0e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:12.380267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:12.381007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:12.381291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:12.381568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:12.390481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:12.391937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:12.406966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:12.407991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:12.409414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:12.412904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 277/548] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:12.414337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:12.526845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:12.546489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6ba7-d7b8-4d85-9e5a-a843f72bb5d2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:12.581672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:12.582444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:12.582730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:12.583056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:12.583914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:12.584225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:12.585665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:12.610407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 272/549] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Jul 12 17:14:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:12.612099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:12.693760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:12.742771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48787ad-92d4-4f10-95e0-90a3cf55429d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:12.787052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f29a83-8a38-430c-980e-92a959975742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:12.787717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29a83-8a38-430c-980e-92a959975742 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:12.787999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29a83-8a38-430c-980e-92a959975742 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:12.788271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29a83-8a38-430c-980e-92a959975742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:12.872429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f29a83-8a38-430c-980e-92a959975742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:12.874586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f29a83-8a38-430c-980e-92a959975742 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:12.949845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:12.987848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 278/550] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:12.993757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.025522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a92d1-a0c0-4ff6-ac16-05b539718c83 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.025837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a92d1-a0c0-4ff6-ac16-05b539718c83 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.026082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a92d1-a0c0-4ff6-ac16-05b539718c83 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.027518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 279/551] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:14:13.037469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3af31-55cc-499c-b39c-0f67a519ac7e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.037758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3af31-55cc-499c-b39c-0f67a519ac7e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.038038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3af31-55cc-499c-b39c-0f67a519ac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.055796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f7b3af31-55cc-499c-b39c-0f67a519ac7e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:13.057012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f7b3af31-55cc-499c-b39c-0f67a519ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:13.163521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 280/552] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:14:13.173971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c530a-fc49-4be5-88ea-36a3026906b8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.207968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3af31-55cc-499c-b39c-0f67a519ac7e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.214271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9a9ac-5608-49e0-bbf1-cfae3e077b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.215273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a9ac-5608-49e0-bbf1-cfae3e077b61 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.215382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a9ac-5608-49e0-bbf1-cfae3e077b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.215649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a9ac-5608-49e0-bbf1-cfae3e077b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.227152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9a9ac-5608-49e0-bbf1-cfae3e077b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:13.228703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f9a9ac-5608-49e0-bbf1-cfae3e077b61 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b9f9a9ac-5608-49e0-bbf1-cfae3e077b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:13.250324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:13.251351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:13.252215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:13.252215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:13.252215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:13.252215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:13.252441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 273/553] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:13.252959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:13.255026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a23fee-1f30-4286-810f-366219a5f9ba None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.255316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a23fee-1f30-4286-810f-366219a5f9ba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.255587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a23fee-1f30-4286-810f-366219a5f9ba None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.257160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 274/554] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:13.262709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a23fee-1f30-4286-810f-366219a5f9ba None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.319932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:13.328243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3af31-55cc-499c-b39c-0f67a519ac7e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.367546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b6873-6829-4892-8587-7a375b56879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.368363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6873-6829-4892-8587-7a375b56879b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.368642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6873-6829-4892-8587-7a375b56879b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.368911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b6873-6829-4892-8587-7a375b56879b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.386367 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b6873-6829-4892-8587-7a375b56879b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c30b6873-6829-4892-8587-7a375b56879b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:13.397904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:13.399463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:13.400434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 281/555] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:13.401141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fd77-60fc-4da0-bd56-2bb76fa28199 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.401141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fd77-60fc-4da0-bd56-2bb76fa28199 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.406753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fd77-60fc-4da0-bd56-2bb76fa28199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.407337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a23fee-1f30-4286-810f-366219a5f9ba None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.425950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c399fd77-60fc-4da0-bd56-2bb76fa28199 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:13.427226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c399fd77-60fc-4da0-bd56-2bb76fa28199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:13.456718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.457396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.457658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.457930 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.458711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:13.458959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:13.460396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:13.477623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 275/556] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:13.478578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.509045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 282/557] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:13.510216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399fd77-60fc-4da0-bd56-2bb76fa28199 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.538735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:13.584691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b2bfb-0dfb-476e-a31e-ff4895ee2bf0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.599728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:13.618464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399fd77-60fc-4da0-bd56-2bb76fa28199 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.619643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.620324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.620606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.620878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.621636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:13.621938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:13.623367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:13.637110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 276/558] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:13.637110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.662433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.663622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.664099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.664593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.671872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:13.673418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:13.688253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:13.689718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 283/559] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:13.691669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.753822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19713a66-a72a-4e1e-a6ff-e1428595a189 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.772798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:13.793637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3fdf09-3043-4d79-8902-9f437ebcdf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.794483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fdf09-3043-4d79-8902-9f437ebcdf70 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.794771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fdf09-3043-4d79-8902-9f437ebcdf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.795043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3fdf09-3043-4d79-8902-9f437ebcdf70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.802017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640eb5f8-ecd6-4f7b-a9ca-8197a2b617bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.805483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3fdf09-3043-4d79-8902-9f437ebcdf70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ca3fdf09-3043-4d79-8902-9f437ebcdf70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:13.813602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:13.814869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 277/560] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:13.820723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91871b9-8a91-4f5b-9992-0dd1c57f0f35 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.821495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91871b9-8a91-4f5b-9992-0dd1c57f0f35 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.821495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91871b9-8a91-4f5b-9992-0dd1c57f0f35 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.821495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 278/561] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:13.821495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91871b9-8a91-4f5b-9992-0dd1c57f0f35 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.844987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.845819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.846102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.846397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.857228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:13.859054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:13.866605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:13.878369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:13.879348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:13.880307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:13.880307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:13.880307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:13.880307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:13.882645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 284/562] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:13.883268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:13.932668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91871b9-8a91-4f5b-9992-0dd1c57f0f35 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:13.969386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f97481-4f1f-476a-b866-63a258c90b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:13.970432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f97481-4f1f-476a-b866-63a258c90b2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.970716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f97481-4f1f-476a-b866-63a258c90b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.971302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f97481-4f1f-476a-b866-63a258c90b2e None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.972094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f97481-4f1f-476a-b866-63a258c90b2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:13.972403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f97481-4f1f-476a-b866-63a258c90b2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:13.973850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f97481-4f1f-476a-b866-63a258c90b2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:13.985834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 279/563] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:13.986872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d872-9ceb-4f01-b0d3-d6ef02bc103f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:13.987160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d872-9ceb-4f01-b0d3-d6ef02bc103f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:13.987436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d872-9ceb-4f01-b0d3-d6ef02bc103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:13.996648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafef5e-ebd9-4864-a4a1-729bd61d3009 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.004021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0987d872-9ceb-4f01-b0d3-d6ef02bc103f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:14.005840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0987d872-9ceb-4f01-b0d3-d6ef02bc103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:14.035866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.036598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.036883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.037218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.037680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.037962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:14.038312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.039681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.053885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 285/564] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:14.053885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.079991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 280/565] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:14.081114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d872-9ceb-4f01-b0d3-d6ef02bc103f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.123115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.167764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c81eb4-106d-485e-beae-09cb0bffb5ef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.184773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d872-9ceb-4f01-b0d3-d6ef02bc103f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.203413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.204080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.204362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.204632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.205346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:14.205648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.207052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.219673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 286/566] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:14.220489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.224754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.225442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.225729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.226003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.226871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5731c3ee4a284ae085eedd600c21bc39) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:14.227186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.228637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.235169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 281/567] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/role_assignments?user.id=5731c3ee4a284ae085eedd600c21bc39&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:14.236004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.275829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.359073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14807-007f-4fe6-8297-b487fef3e644 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.368506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6372b8-ec63-470f-a955-326fe34af35d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.400313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.401147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.401430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.401706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.402951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.413920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:14.422267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:14.423289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:14.424129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:14.428622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 282/568] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:14.429341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.429594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.430568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.431021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.431471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.445944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.448863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:14.474217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:14.475187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:14.476075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:14.476075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:14.476075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:14.476075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:14.478908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 287/569] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:14.479934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.547555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.561968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42189d-5247-4203-aa95-f755b23b86d5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.608789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.609838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.610265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.610705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.611094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33584304-7261-4cc6-877d-0341fc359cef None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.622121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.624210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:14.640617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:14.641773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:14.643023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 283/570] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:14.643751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.657076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a59dc-1bc8-481b-b858-bd02761ebb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.657998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a59dc-1bc8-481b-b858-bd02761ebb19 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.658522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a59dc-1bc8-481b-b858-bd02761ebb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.658964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a59dc-1bc8-481b-b858-bd02761ebb19 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a59dc-1bc8-481b-b858-bd02761ebb19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:14.660315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a59dc-1bc8-481b-b858-bd02761ebb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.661824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a59dc-1bc8-481b-b858-bd02761ebb19 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.670372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 288/571] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:14.672031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7b4d-afbe-4432-ab80-eb51776ab571 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.672317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7b4d-afbe-4432-ab80-eb51776ab571 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.672591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7b4d-afbe-4432-ab80-eb51776ab571 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.673949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 289/572] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:14.678755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da7b4d-afbe-4432-ab80-eb51776ab571 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.716862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.760753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeac75-6bec-4537-977a-f5716412afe4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.792843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da7b4d-afbe-4432-ab80-eb51776ab571 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.796570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.797240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.797519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.797841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.798534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:14.798837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.800236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.813304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 284/573] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:14.815770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.831354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087afcc-dc6b-4587-bfb9-f84c99ab8fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.832140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087afcc-dc6b-4587-bfb9-f84c99ab8fab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.832432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087afcc-dc6b-4587-bfb9-f84c99ab8fab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.832711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087afcc-dc6b-4587-bfb9-f84c99ab8fab None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.833623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087afcc-dc6b-4587-bfb9-f84c99ab8fab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:14.833934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087afcc-dc6b-4587-bfb9-f84c99ab8fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.834437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.835450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087afcc-dc6b-4587-bfb9-f84c99ab8fab None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:14.857659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 290/574] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:14.860228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a5645-01c7-433a-b6fa-8ebbf7d164b1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.860583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a5645-01c7-433a-b6fa-8ebbf7d164b1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.860927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a5645-01c7-433a-b6fa-8ebbf7d164b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.882155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-415a5645-01c7-433a-b6fa-8ebbf7d164b1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:14.883374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-415a5645-01c7-433a-b6fa-8ebbf7d164b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:14.930274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc7f43f-8f4e-4bdf-9410-ba223b3c9e2d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:14.951944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 291/575] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:14.952619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a5645-01c7-433a-b6fa-8ebbf7d164b1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:14.972018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:14.973285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:14.973791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:14.974258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:14.986076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:14.986663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:14.988710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:15.008703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:15.009608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:15.010529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:15.010529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:15.010529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:15.010529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:15.016957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 285/576] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:15.018062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.066170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a5645-01c7-433a-b6fa-8ebbf7d164b1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.087855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.102037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.102886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.103171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.103427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.110953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.112451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.129544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df487290-dce9-40b4-a17d-976c6535d1fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:15.131641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:15.132562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:15.133509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 292/577] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:15.134084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.170748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.171382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.171503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.171747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.183008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.185007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:15.205742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:15.206775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:15.207877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:15.207877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:15.207877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:15.207877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:15.209600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 286/578] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:15.210573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.228984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.251004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056e368-0247-43de-aa13-9efa723a9a75 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.287481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.288286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.288571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.288841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.299297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:15.307329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:15.308283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:15.309152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:15.313832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 293/579] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:15.314711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.323983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddec3bb-c8b2-4625-8b3c-a755e4318199 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.341879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.364419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.365114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.365393 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.365664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.366784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:15.367085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.368447 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.380028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 287/580] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:15.380836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.427600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194d758-cffc-499a-923e-32bb8fdc0ad1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.464164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51541718-7771-4202-9324-7570848174c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.464968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51541718-7771-4202-9324-7570848174c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.465253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51541718-7771-4202-9324-7570848174c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.465529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51541718-7771-4202-9324-7570848174c1 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.466517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51541718-7771-4202-9324-7570848174c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:15.466922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51541718-7771-4202-9324-7570848174c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.469122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51541718-7771-4202-9324-7570848174c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.485726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.487181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43923d12-7335-4f33-afd4-7b8b8f3e8f30 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.491189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 294/581] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:15.492096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51541718-7771-4202-9324-7570848174c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.533648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.534628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.535051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.535812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.536986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:15.537598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.539483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.555976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 288/582] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:15.558027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.598811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51541718-7771-4202-9324-7570848174c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.606529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.634752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.635432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.635717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.635997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.636748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:15.637056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.638461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.647876 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 295/583] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:15.648826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.680553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2526-21db-4000-a41a-9efc941eb99c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.713840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.718730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.719714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.720086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.720438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.728832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.730202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:15.745973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:15.747170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 17:14:15.748344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:15.753735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 289/584] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:15.753735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.763712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6423f1e-5346-4d73-880b-1932cf8b271b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.803096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.804068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.804673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.804673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.815899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.817453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:15.834474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:15.835569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:15.836634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:15.836634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:15.836634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:15.836634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:15.836634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 296/585] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:15.840807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.854924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.860705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f85d5-d669-4b8c-a941-1702c5db22f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.896033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.896896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.897206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.897492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:15.904820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:15.906531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:15.920900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:15.921846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:15.922763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 290/586] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:15.923245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:15.955442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347ed57-a1ab-43ec-9fb7-1a52e308c5f6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:15.970264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:15.992783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:15.993595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:15.993878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:15.994151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.006533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.007985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:16.025532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:16.026725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:16.027837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:16.027837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:16.027837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:16.027837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:16.031528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 297/587] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:16.032388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.032642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e3863-2810-452a-9548-8cedd76fbbe1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.067597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.068284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.068564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.068841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.069681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:16.069990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.071467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.094194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 291/588] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Jul 12 17:14:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:16.095099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.111558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:16.144248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7bcb0-f986-41b1-9c45-e286e423f2d0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.180279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.181134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.181531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.181872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.182725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:16.183214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.184794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.201593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 298/589] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:16.201794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652a84d-e071-49f7-9898-e3ee750b8310 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.201892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.230125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:16.238066 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.238855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.239196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.239494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.240268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:16.240580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.242424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.259366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 292/590] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:16.259366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.314562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321886a-7c6f-4bd7-8a59-5c16daef35af None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.335038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:16.351588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.352273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.352558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.352835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.353630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:16.353873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.355287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.365343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa445-a731-42d6-ba7b-3272eaf87784 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.368717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 299/591] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:16.369525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.399541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.400348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.400626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.400904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.411732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.413254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:16.430484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:16.431556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:16.432710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:16.432710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:16.432710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:16.432710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:16.432710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 293/592] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:16.432710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.457942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:16.474008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1e4ee-3ea8-4a6e-bd22-1787f262528d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.507757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613edb98-b5ce-40d3-a84f-7625972fc7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.508554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613edb98-b5ce-40d3-a84f-7625972fc7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.508833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613edb98-b5ce-40d3-a84f-7625972fc7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.509101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613edb98-b5ce-40d3-a84f-7625972fc7d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.516098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613edb98-b5ce-40d3-a84f-7625972fc7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.517565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613edb98-b5ce-40d3-a84f-7625972fc7d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.531343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1aad3-b753-4ea0-8a51-b25d8dbae4b1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-613edb98-b5ce-40d3-a84f-7625972fc7d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:16.532325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:16.533329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:16.534442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 300/593] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:16.535239 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebdb04-0ba2-4a25-bf52-6a9bc6bad928 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.535545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebdb04-0ba2-4a25-bf52-6a9bc6bad928 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.535649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebdb04-0ba2-4a25-bf52-6a9bc6bad928 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.541093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 301/594] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:16.541093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebdb04-0ba2-4a25-bf52-6a9bc6bad928 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.561960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:16.572036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.572948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.573230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.573507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5253b3eec6ae45f3bca9369107c4d93a/roles/b18a579464c34ea6b4fb3ea7940aa4f6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.591680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=5253b3eec6ae45f3bca9369107c4d93a, role_id=b18a579464c34ea6b4fb3ea7940aa4f6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.593431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.608377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 294/595] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:16 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5253b3eec6ae45f3bca9369107c4d93a/roles/b18a579464c34ea6b4fb3ea7940aa4f6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:16.609460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.655088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebdb04-0ba2-4a25-bf52-6a9bc6bad928 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.694453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.695287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.695562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.695830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.705281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.706802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:16.723139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:16.724191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:16.725166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 302/596] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:16.725769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.735911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:16.743289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2580a8-5cfd-4c9c-bf02-41eb7ba29768 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.789026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd13d67-7390-4cd0-8c56-79eed32a1be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.789703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd13d67-7390-4cd0-8c56-79eed32a1be3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.790013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd13d67-7390-4cd0-8c56-79eed32a1be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.790295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd13d67-7390-4cd0-8c56-79eed32a1be3 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.791045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd13d67-7390-4cd0-8c56-79eed32a1be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:16.791402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd13d67-7390-4cd0-8c56-79eed32a1be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.792791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd13d67-7390-4cd0-8c56-79eed32a1be3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.805429 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 295/597] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:16.809832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453386c-9758-44bb-b681-4e3cb96527e2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.809832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453386c-9758-44bb-b681-4e3cb96527e2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.809832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453386c-9758-44bb-b681-4e3cb96527e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.826094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1453386c-9758-44bb-b681-4e3cb96527e2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:16.827671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1453386c-9758-44bb-b681-4e3cb96527e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:16.836812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9d8eb-ea8d-4bf2-a64f-f90c5d4b2862 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:16.858782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:16.875370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:16.876044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:16.876321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:16.876603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:16.877395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:16.877703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:16.879178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:16.896482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 303/598] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:16.897455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.910417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 296/599] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:16.910417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453386c-9758-44bb-b681-4e3cb96527e2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:16.973594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.009062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c1cdc-7666-462b-af63-704e4cf2da45 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.014550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453386c-9758-44bb-b681-4e3cb96527e2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.043222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.043905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.044184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.044461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.045307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:17.045697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.047346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.050071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.051026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.051365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.051693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.059028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.060661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.070667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 304/600] 10.222.0.50 () {56 vars in 1139 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:17.071900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:17.075319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:17.076247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:17.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:17.078460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 297/601] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:17.079360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.108256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.184662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461cdc5-8fd1-4406-a5e5-50e61045c12f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.185014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8b68-b07a-4989-985d-d1db1ef26a47 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.210329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.221457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263da426-6263-49a8-a43b-aec0934219af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.222405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263da426-6263-49a8-a43b-aec0934219af None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.222751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263da426-6263-49a8-a43b-aec0934219af None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.223052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.223159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263da426-6263-49a8-a43b-aec0934219af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.224076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.224428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.224767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/c30dd51dbbb245a485be48fce34295e8/roles/b18a579464c34ea6b4fb3ea7940aa4f6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.234702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263da426-6263-49a8-a43b-aec0934219af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:17.240154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=c30dd51dbbb245a485be48fce34295e8, role_id=b18a579464c34ea6b4fb3ea7940aa4f6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.242078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-263da426-6263-49a8-a43b-aec0934219af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:17.243389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:17.244470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:17.245516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:17.251849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 298/602] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:17.251849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263da426-6263-49a8-a43b-aec0934219af None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.274390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 305/603] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:17 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/c30dd51dbbb245a485be48fce34295e8/roles/b18a579464c34ea6b4fb3ea7940aa4f6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:17.275556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.354108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.372149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263da426-6263-49a8-a43b-aec0934219af None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.394688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e455e25-1542-4f18-b4e7-25bb0b75692d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.411587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.412710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.412984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.413362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.425741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.428138 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.436851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.437813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.438118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.438427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.439235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:17.439548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.440972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.458375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 306/604] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:17.460134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:17.461207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:17.462354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:17.462354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:17.462354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:17.462354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:17.462354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 299/605] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:17.462354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.463864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.578581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a864e-0326-49c9-ab20-f1becf945cca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.599904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57104474-aa95-4f61-a171-6a2b8079c59b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.618236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.619577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.619993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.620444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/7724df01ff1444a09a751bb54dabc222/roles/b18a579464c34ea6b4fb3ea7940aa4f6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.637001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=7724df01ff1444a09a751bb54dabc222, role_id=b18a579464c34ea6b4fb3ea7940aa4f6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.638472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.638890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.639425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.640505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.640901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.641913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:17.642343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.644546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.650857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.661080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 300/606] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:17.661080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.663492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 307/607] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:17 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/7724df01ff1444a09a751bb54dabc222/roles/b18a579464c34ea6b4fb3ea7940aa4f6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:17.664508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.846965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcad0a-9bf2-4dcc-9ef0-8f3dd6fd9cb8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.872965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.886352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.887162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.887584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.887954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.888787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:17.889373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.891141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.904583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 301/608] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:17.911727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:17.916292 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a51d4-b395-4210-8090-0a801a3165cc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:17.955443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:17.956497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:17.956891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:17.957263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:17.969745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:17.971393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:17.980002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:17.990519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:17.992071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:17.993170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:17.993170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:17.993170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:17.993170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:17.994628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 308/609] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:18.015911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:18.033476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b99e74-a7e0-413e-91ec-1d0291ae26ec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:18.069740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:18.071126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.071609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.072078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.089685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:18.097195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:18.126759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:18.127739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:18.128622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:18.138955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 302/610] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:18.140396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:18.145943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449a899-2f4d-4879-9161-49b99a973a11 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:18.211217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:18.212358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.212865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.213395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.214345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:18.214863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:18.217096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:18.230657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:18.243817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 309/611] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:18.250404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:18.344694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ffc1-368b-4751-a072-5932dae441ea None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:18.397840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5bc2d-d2b5-4681-bac5-400422c31ca1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:18.401348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:18.443418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:18.444107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.444392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.444667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.445471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:18.445786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:18.447265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:18.450766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:18.451660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.452612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.453533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.466272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 303/612] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:18.471909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:18.473398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:18.475359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:18.489632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:18.490693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:18.491962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 310/613] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:18.499437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:18.615315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:18.681790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986a5e8-0c2f-417f-b1e8-c83cf2ca578d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:18.698197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4a6f-5c25-4ca2-a426-9d8d603bd610 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:18.747885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadbfe8-2a5f-4630-ae5d-f2b1a36ccc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:18.749381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadbfe8-2a5f-4630-ae5d-f2b1a36ccc0b None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.751055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadbfe8-2a5f-4630-ae5d-f2b1a36ccc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.751338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadbfe8-2a5f-4630-ae5d-f2b1a36ccc0b None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/164446c4b65e4043a492dc626a571e81/roles/b18a579464c34ea6b4fb3ea7940aa4f6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.762316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:18.765040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.765564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.766057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.767384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:18.768878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:18.770722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:18.778025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadbfe8-2a5f-4630-ae5d-f2b1a36ccc0b None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=164446c4b65e4043a492dc626a571e81, role_id=b18a579464c34ea6b4fb3ea7940aa4f6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:18.780176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadbfe8-2a5f-4630-ae5d-f2b1a36ccc0b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:18.799792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 311/614] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Jul 12 17:14:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:18.812476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 304/615] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:18 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/164446c4b65e4043a492dc626a571e81/roles/b18a579464c34ea6b4fb3ea7940aa4f6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:18.813419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:18.939786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff930-5696-47be-8e99-d16398c2b842 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.939984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff930-5696-47be-8e99-d16398c2b842 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.940265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ff930-5696-47be-8e99-d16398c2b842 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.941933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 305/616] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:14:18.947335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881beaff-e161-4aa8-8f68-b3af27611de4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:18.947634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881beaff-e161-4aa8-8f68-b3af27611de4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:18.947916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881beaff-e161-4aa8-8f68-b3af27611de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:18.952441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0cec0-f719-4d2b-b205-8f27852bf166 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:18.967249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-881beaff-e161-4aa8-8f68-b3af27611de4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:18.968724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-881beaff-e161-4aa8-8f68-b3af27611de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:18.980836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:19.008533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.009356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.009635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.009907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.021183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:19.032349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:19.033886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:19.055072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:19.056046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:19.056969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:19.056969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:19.056969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:19.056969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:19.056969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 312/617] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:19.071399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.093962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 306/618] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:14:19.130692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881beaff-e161-4aa8-8f68-b3af27611de4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.206596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c250f-5942-4f9d-8792-cb27aaddb0c0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:19.238759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881beaff-e161-4aa8-8f68-b3af27611de4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:19.253704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.254925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.254925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.256972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.257722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:19.258033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:19.259469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:19.276042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 313/619] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:19.281548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.307934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.308757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.309032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.309299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.332490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:19.332718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:19.347542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:19.348760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:19.349651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:19.351015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 307/620] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:19.367335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.423851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904ecc6-f23b-42a9-a87e-fabed28e3b88 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:19.425243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:19.462106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.462854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.463136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.463406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.471148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:19.472755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:19.490341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:19.491709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:19.492610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 314/621] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:19.496617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.587560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9793d9-8472-41c8-99ea-0b8e8000e462 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:19.630976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:19.640503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda7517-0451-4980-8f77-86cc28f4762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.641681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7517-0451-4980-8f77-86cc28f4762d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.642103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7517-0451-4980-8f77-86cc28f4762d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.642927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda7517-0451-4980-8f77-86cc28f4762d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.644269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7517-0451-4980-8f77-86cc28f4762d None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:19.644833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7517-0451-4980-8f77-86cc28f4762d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:19.646435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda7517-0451-4980-8f77-86cc28f4762d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:19.646907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e51db-bf11-45e2-94be-aa2ec6c93440 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:19.661708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 308/622] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:19.661708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77e55-2a5b-476f-bbd4-523567a77243 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.661708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77e55-2a5b-476f-bbd4-523567a77243 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.661708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c77e55-2a5b-476f-bbd4-523567a77243 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.666036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 309/623] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:19.667230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77e55-2a5b-476f-bbd4-523567a77243 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.691111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8abdbf-0114-470b-81d3-835790689af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.692548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8abdbf-0114-470b-81d3-835790689af9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.693141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8abdbf-0114-470b-81d3-835790689af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.693608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8abdbf-0114-470b-81d3-835790689af9 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.694729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8abdbf-0114-470b-81d3-835790689af9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:19.695250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8abdbf-0114-470b-81d3-835790689af9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:19.697068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8abdbf-0114-470b-81d3-835790689af9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:19.711545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 315/624] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:19.713263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2167f-021f-4c09-870c-f152855090f1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.713749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2167f-021f-4c09-870c-f152855090f1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.714232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2167f-021f-4c09-870c-f152855090f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.732327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a7a2167f-021f-4c09-870c-f152855090f1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:19.734533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a7a2167f-021f-4c09-870c-f152855090f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:19.766016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:19.787705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c77e55-2a5b-476f-bbd4-523567a77243 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:19.825820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.826815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:19.827190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:19.827582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:19.830379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 316/625] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:19.831605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2167f-021f-4c09-870c-f152855090f1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.848748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:19.850220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:19.874710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:19.875680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:19.877203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:19.877203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:19.877203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:19.877203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:19.877203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 310/626] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:19.877203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:19.927346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:19.956136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2167f-021f-4c09-870c-f152855090f1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:19.998738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:19.999992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.000474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.000764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5731c3ee4a284ae085eedd600c21bc39/roles/b18a579464c34ea6b4fb3ea7940aa4f6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.012717 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93465bdf-9657-4511-ac26-6787f28688e4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.016893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=5731c3ee4a284ae085eedd600c21bc39, role_id=b18a579464c34ea6b4fb3ea7940aa4f6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:20.017923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:20.035813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 317/627] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:19 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5731c3ee4a284ae085eedd600c21bc39/roles/b18a579464c34ea6b4fb3ea7940aa4f6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:20.036785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.054835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.056409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.056917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.057456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.060064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:20.071530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:20.080881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:20.081951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:20.082845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:20.085959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 311/628] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:20.091784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.188511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db2dad-9e03-4911-94ad-cfa07be5a91b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.212485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e737df-db6a-45c7-9d41-14b4d77d3718 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.227385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:20.240470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598bb12-e605-48ed-b3c0-1529434b3f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.241947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598bb12-e605-48ed-b3c0-1529434b3f7c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.242948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598bb12-e605-48ed-b3c0-1529434b3f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.243231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598bb12-e605-48ed-b3c0-1529434b3f7c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.244442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598bb12-e605-48ed-b3c0-1529434b3f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:20.244442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598bb12-e605-48ed-b3c0-1529434b3f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:20.245833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598bb12-e605-48ed-b3c0-1529434b3f7c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:20.258857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f86ece-e20d-4a25-88bf-a9f8c494cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.259045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 318/629] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:20.259560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f86ece-e20d-4a25-88bf-a9f8c494cc5e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.260052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f86ece-e20d-4a25-88bf-a9f8c494cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.260052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f86ece-e20d-4a25-88bf-a9f8c494cc5e None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.260232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85a7a-18e6-4b74-8558-f39b21e66ba3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.260986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85a7a-18e6-4b74-8558-f39b21e66ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.261095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f86ece-e20d-4a25-88bf-a9f8c494cc5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:20.261180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e85a7a-18e6-4b74-8558-f39b21e66ba3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.261257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f86ece-e20d-4a25-88bf-a9f8c494cc5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:20.262426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 319/630] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:20.267258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f86ece-e20d-4a25-88bf-a9f8c494cc5e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:20.267734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e85a7a-18e6-4b74-8558-f39b21e66ba3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.278918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 312/631] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:20.281327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5761e2-f435-4070-a308-ff75b2081d6c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.281829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5761e2-f435-4070-a308-ff75b2081d6c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.282754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5761e2-f435-4070-a308-ff75b2081d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.302537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6f5761e2-f435-4070-a308-ff75b2081d6c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:20.304055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f5761e2-f435-4070-a308-ff75b2081d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:20.371242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:20.398081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 313/632] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:20.399381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5761e2-f435-4070-a308-ff75b2081d6c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.425480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e85a7a-18e6-4b74-8558-f39b21e66ba3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.468913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.470350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.470675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.470953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.479609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:20.481064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:20.497705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:20.499342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:20.500311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:20.503989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 320/633] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:20.504925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.528860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5761e2-f435-4070-a308-ff75b2081d6c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.556786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:20.581098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.582234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.582554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.582833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.595495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:20.599323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:20.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:20.620742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:20.621628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:20.621628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:20.621628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:20.621628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:20.625962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 314/634] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:20.627033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.628806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63561034-55a7-42f5-84b1-3305e8b82e62 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.673590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:20.677524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.678734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.678852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.679154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.690790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:20.698842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:20.699792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:20.700625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:20.705394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 321/635] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:20.706360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.753600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f970e-8d97-4792-8cf9-65cc4555c84e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.798644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.800392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.801111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.801545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.802756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:20.803233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:20.805426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:20.813523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b7438-38f0-443c-873f-9918c32865ab None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:20.821473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:20.834342 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 315/636] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:20.834342 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.860317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:20.861134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:20.861610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:20.862020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:20.862938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:20.863365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:20.864836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:20.884257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 322/637] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:20.885951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:20.949851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:20.957113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc52af-8f49-4e65-bace-234f606f7a81 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.001920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.003018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.003602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.004038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.004940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:21.005398 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.007236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.018784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 316/638] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:21.019815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.060340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776502f-bdf8-4114-9dc3-e4aefd43554e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.118913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b1a32-240f-4324-8857-e68f44d23a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.120299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b1a32-240f-4324-8857-e68f44d23a15 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.120879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b1a32-240f-4324-8857-e68f44d23a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.121266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b1a32-240f-4324-8857-e68f44d23a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.153137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06d11b-17ac-4ee0-9e9a-41281a38140a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.157378 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:21.193892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b1a32-240f-4324-8857-e68f44d23a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.195387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b1a32-240f-4324-8857-e68f44d23a15 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.212707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.213845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.214237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.214658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.222853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.224472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:21.244211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:21.245204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:21.246139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:21.246728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 317/639] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:21.247210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.270802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:21.311808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 323/640] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:21.311808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f624b-5d03-454a-adc7-82754ab9c4d4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.311808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f624b-5d03-454a-adc7-82754ab9c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.311808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f624b-5d03-454a-adc7-82754ab9c4d4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.311808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 324/641] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:21.311808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f624b-5d03-454a-adc7-82754ab9c4d4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.364277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4606acc-5594-4d8e-9f12-c2996c1d5544 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.388473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:21.401741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.402583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.402865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.403136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.414154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.415704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.431093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f624b-5d03-454a-adc7-82754ab9c4d4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:21.435374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:21.436364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:21.437265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:21.437265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:21.437265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:21.437265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:21.442156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 318/642] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:21.443046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.468312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04220649-97bb-436e-b7c0-381bcde3ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.469222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04220649-97bb-436e-b7c0-381bcde3ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.469506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04220649-97bb-436e-b7c0-381bcde3ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.469774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04220649-97bb-436e-b7c0-381bcde3ebe9 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.470641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04220649-97bb-436e-b7c0-381bcde3ebe9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:21.470933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04220649-97bb-436e-b7c0-381bcde3ebe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.472389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04220649-97bb-436e-b7c0-381bcde3ebe9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.489323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 325/643] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:21.490631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfec96-e3f4-4cdf-a460-d292985a5634 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.491268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfec96-e3f4-4cdf-a460-d292985a5634 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.491538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfec96-e3f4-4cdf-a460-d292985a5634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.507634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e7dfec96-e3f4-4cdf-a460-d292985a5634 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:21.508812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e7dfec96-e3f4-4cdf-a460-d292985a5634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:21.523905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:21.559018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8806cb-1ad9-4571-b893-e92f55909b94 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.582815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 326/644] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:21.582815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfec96-e3f4-4cdf-a460-d292985a5634 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.604836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.605661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.605945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.606218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.617976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.619478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:21.636756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:21.637693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:21.638802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:21.638802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:21.638802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:21.638802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:21.638802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 319/645] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:21.638802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.645134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:21.690295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfec96-e3f4-4cdf-a460-d292985a5634 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.726240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.726938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.727222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.727494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.728220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:21.728526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.729903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.743362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 327/646] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:21.744356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6161-318c-486d-8a1e-5f67cd2788ce None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.748664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.767809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:21.782020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.782741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.783149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.783433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.853486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c0717-dada-44bd-91de-71d3a3bbaa23 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:21.857007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:21.859227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:21.868365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:21.890011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:21.890843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:21.891123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:21.891391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:21.901625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:21.909523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:21.910481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:21.911333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 328/647] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:21.912043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:21.977752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 320/648] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:21.979236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.007741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.017737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ae741-c73c-48a1-bf35-48e5b2a6844c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.052880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.053654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.053948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.054233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.055012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:22.055329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.056721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.069788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 329/649] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:22.070751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.095676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e71e6-ae24-432e-94ef-a7301652e188 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.105894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.132169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.133097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.133367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.133708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.141143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.142640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:22.157470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:22.158811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 321/650] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:22.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.179011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a0c59-ec45-4297-b09b-242a73b794ea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.214403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.215076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.215359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.215628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.216371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:22.216670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.218058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.226268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 330/651] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:22.227077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.257552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.278260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf85db-91de-4ece-8c37-c11286b07713 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.313698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.314546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.314828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.315228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.320902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.325799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.327273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f8bf-ed0a-41b5-9a3e-d0976f446e5d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.327392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:22.345034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:22.345964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:22.352033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:22.352033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:22.352033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:22.352033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:22.352033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 322/652] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:22.352033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.361761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.362492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.362781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.363059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.370267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.371723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:22.385934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:22.386943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:22.387827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 331/653] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:22.388308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.449691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82c950-3ec3-4667-b48a-967f1ddaa44b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.484641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f78c38-4d4b-4144-8081-6ef65fa16dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.485318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78c38-4d4b-4144-8081-6ef65fa16dbc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.485604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78c38-4d4b-4144-8081-6ef65fa16dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.485880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78c38-4d4b-4144-8081-6ef65fa16dbc None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.486122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92266d42-f388-4dd3-9757-6399aa687e37 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.486746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f78c38-4d4b-4144-8081-6ef65fa16dbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:22.487056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f78c38-4d4b-4144-8081-6ef65fa16dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.488490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f78c38-4d4b-4144-8081-6ef65fa16dbc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.490132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.507237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 323/654] 10.222.0.50 () {56 vars in 1137 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:22.508504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5abf-b9f8-4429-92f5-24df6d623449 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.508791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5abf-b9f8-4429-92f5-24df6d623449 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.509068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f5abf-b9f8-4429-92f5-24df6d623449 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.510333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 324/655] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:22.510996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5abf-b9f8-4429-92f5-24df6d623449 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.523432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.524237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.524520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.524795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.535372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.536807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:22.554075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:22.555060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:22.555966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:22.555966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:22.555966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:22.555966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:22.555966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 332/656] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:22.556247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.566366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.617348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f5abf-b9f8-4429-92f5-24df6d623449 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.652077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.652752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.653025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.653295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.654031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:22.654357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.655936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.659653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4554a84-05ea-48b6-8ac4-0f4b4150d393 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.667168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 325/657] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:22.667972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.693901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1c81f-012b-4a93-963d-ab50aa7219c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.694615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1c81f-012b-4a93-963d-ab50aa7219c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.694896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1c81f-012b-4a93-963d-ab50aa7219c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.695167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1c81f-012b-4a93-963d-ab50aa7219c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.695959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1c81f-012b-4a93-963d-ab50aa7219c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:22.696267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1c81f-012b-4a93-963d-ab50aa7219c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.697710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1c81f-012b-4a93-963d-ab50aa7219c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.709086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 333/658] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:22.710110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedcaeb-b2bf-4597-94d0-f6fa5eea7eba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.710428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedcaeb-b2bf-4597-94d0-f6fa5eea7eba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.710715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedcaeb-b2bf-4597-94d0-f6fa5eea7eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.723802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.727959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6bedcaeb-b2bf-4597-94d0-f6fa5eea7eba None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:22.729617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bedcaeb-b2bf-4597-94d0-f6fa5eea7eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:22.776111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c7c16-15d1-4060-a143-bc8892216f59 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.802767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.808677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 334/659] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:22.809873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedcaeb-b2bf-4597-94d0-f6fa5eea7eba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:22.820282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.820931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.821221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.821492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.900496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.901885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.907929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedcaeb-b2bf-4597-94d0-f6fa5eea7eba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:22.941741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:22.942439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:22.942720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:22.942992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:22.943718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:22.944024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:22.945396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:22.954378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:22.956903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 335/660] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:22.957700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.008262 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 326/661] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:23.009108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.015533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.057445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dac6f-e15a-46d3-8b78-9e272029cdac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.092138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.093102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.093382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.093653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.101284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.102811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.117904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f515d-da74-4fdb-976b-21ca50c5d69c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:23.118078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:23.119076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:23.119963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 336/662] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:23.120436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.166032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.166644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.166921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.167187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.168012 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5253b3eec6ae45f3bca9369107c4d93a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:23.168318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.169775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.176187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 327/663] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/role_assignments?user.id=5253b3eec6ae45f3bca9369107c4d93a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:23.176815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.211351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.236729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a6e4b-0e55-4ef8-8a5f-8a83d3ea8e5e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.258272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.279964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.281106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.281529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.281775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.293348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:23.302594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:23.303711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:23.304541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:23.305201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617435b-44e7-497e-9e9b-dbec1f665795 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.305284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 337/664] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:23.305284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.346444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.347267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.347539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.347809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.355940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.357404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:23.372473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:23.373878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:23.374946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 328/665] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:23.375677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.424549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051db9a-18a2-4247-b852-e05b4252a1a8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.473112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.473891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.474013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.474192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.474490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.486795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.488263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.499673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17999a9-1dd4-4fb6-aa45-1335e8a78157 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:23.512910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:23.513815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:23.514769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:23.514769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:23.514769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:23.514769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:23.514769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 338/666] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:23.515387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.546519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.547185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.547470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.547746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.548542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:23.548852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.550318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.550658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.568265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 329/667] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:23.568265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.641612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9bbd2-d35f-44c3-89a0-274dd904ce98 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.676991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.677587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.677800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57ee2-c94a-4197-9257-8afeeedf2174 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.677904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.678135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.678916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:23.679229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.680615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.689549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 339/668] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:23.690407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.725748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.726481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.726927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.727210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.728632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:23.728952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.730568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.735315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.753327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 330/669] 10.222.0.50 () {56 vars in 1139 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:23.754168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.798416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.808749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1316-b1c8-49cb-8d6b-213ac804cfed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.844923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.845598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.845879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.846154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.846911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:23.847213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.848590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.861761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17622-75b6-498b-8563-c9b8a91931da None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:23.862022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 340/670] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:23.862893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.902569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:23.903347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:23.903633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:23.903907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:23.904847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=c30dd51dbbb245a485be48fce34295e8) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:23.905270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:23.906743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:23.922322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 331/671] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/role_assignments?user.id=c30dd51dbbb245a485be48fce34295e8&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:23.922322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:23.989813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:23.999562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802c270-ac46-44b0-87c7-ac4b769536aa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.038547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66320b3-0abb-4f4a-9f68-48228e1039fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.050831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.052155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.052645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.053117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.065858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.067784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.077880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.078663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.078946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.079221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:24.089780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:24.090784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:24.091751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:24.091751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:24.091751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:24.091751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:24.094271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 341/672] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:24.095345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.099364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:24.166260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.167780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.219877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e918c-9b2a-47aa-9874-d1ee332f5689 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.237914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:24.261831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.262979 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.263464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.264275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.273357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.275243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:24.292833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:24.294080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:24.295028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:24.295707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 332/673] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:24.295707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.302089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 342/674] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:24.302089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.378153 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:24.423241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05522c3-d0c4-489a-9780-b10bed6e3c52 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.429048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65021202-635b-4bfe-9302-c4b8bbc9e2eb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.458691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.459359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.459851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.459959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.460604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:24.460909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.462295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.472879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.474014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.474488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.474901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.479706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 333/675] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:24.479706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.496608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.498367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:24.499300 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:24.525621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:24.526808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:24.528004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:24.528004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:24.528004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:24.528004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:24.530456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 343/676] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:24.531631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.605011 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928d522-0a4c-434e-9d0d-d2050e97e691 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.650408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.650816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519615d-69e9-43e3-b55e-5484ce7ff8bd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.651081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.651361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.651627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.652411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:24.652715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.655474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.669736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:24.671286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 334/677] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:24.673154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.696513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.697767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.698307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.698778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.707437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.709257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:24.724596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:24.725575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:24.726556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:24.733724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 344/678] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:24.735031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.764786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:24.788392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d85790-87cf-4a21-aa67-50ac9978edf4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.824521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.825474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.825895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.826353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.827431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:24.827897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.829422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.846266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 335/679] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:24.847441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.848266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bce641-9ce4-439e-9e99-b58e098d38dd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:24.884412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:24.885238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:24.885615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:24.885985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:24.886954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=7724df01ff1444a09a751bb54dabc222) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:24.887364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:24.889203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:24.902332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 345/680] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/role_assignments?user.id=7724df01ff1444a09a751bb54dabc222&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:24.902332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:24.972277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:25.041754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069f2d-d945-4dd8-bd77-d1135b92ec32 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:25.046448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307c0dc-5a3b-40a1-ad04-d5ca4ccf12a7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:25.087489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:25.088937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.089519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.089912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.099938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:25.101529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:25.105733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:25.106455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.106744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.107016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.108106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:25.108439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:25.110095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:25.119727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:25.120893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:25.121773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:25.122572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 346/681] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:25.123069 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:25.130267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:25.133680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 336/682] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Jul 12 17:14:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:25.142053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:25.257547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:25.261887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bc4ee-af69-442a-9b0b-25d3da302d66 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:25.263228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce002c23-71f0-4aff-aeb3-7e1804d23723 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:25.303815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:25.304865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.305362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.305832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.306851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:25.307375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:25.307714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21967259-189e-4f30-9fb7-6069a0cafc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:25.308379 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967259-189e-4f30-9fb7-6069a0cafc50 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.308661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967259-189e-4f30-9fb7-6069a0cafc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.308935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967259-189e-4f30-9fb7-6069a0cafc50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.309983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:25.324824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 347/683] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:25.330258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:25.387051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:25.393961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21967259-189e-4f30-9fb7-6069a0cafc50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:25.396304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21967259-189e-4f30-9fb7-6069a0cafc50 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:25.450473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed949d88-04ca-42ca-b20d-4755c319cf43 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:25.496425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e841b68-9dd1-49fb-8183-e15305b73efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:25.497346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841b68-9dd1-49fb-8183-e15305b73efd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.497769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841b68-9dd1-49fb-8183-e15305b73efd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.498206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e841b68-9dd1-49fb-8183-e15305b73efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.499842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e841b68-9dd1-49fb-8183-e15305b73efd None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=164446c4b65e4043a492dc626a571e81) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:25.500306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e841b68-9dd1-49fb-8183-e15305b73efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:25.502386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e841b68-9dd1-49fb-8183-e15305b73efd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:25.510956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 348/684] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:25 2022] GET /identity/v3/role_assignments?user.id=164446c4b65e4043a492dc626a571e81&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:25.512550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd48aa-8bfd-4322-b47a-e1a5204e7e59 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.512980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd48aa-8bfd-4322-b47a-e1a5204e7e59 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.513463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd48aa-8bfd-4322-b47a-e1a5204e7e59 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.515495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 349/686] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:25.518348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 337/686] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:25.519995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd48aa-8bfd-4322-b47a-e1a5204e7e59 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:25.521905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe80dd-7462-4139-bff3-1b9500573b44 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.522191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe80dd-7462-4139-bff3-1b9500573b44 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.522509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe80dd-7462-4139-bff3-1b9500573b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.567065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9efe80dd-7462-4139-bff3-1b9500573b44 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:25.568482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9efe80dd-7462-4139-bff3-1b9500573b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:25.578713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:25.696598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 338/687] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:25.725063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd48aa-8bfd-4322-b47a-e1a5204e7e59 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:25.729411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe80dd-7462-4139-bff3-1b9500573b44 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:25.761150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:25.766001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:25.767346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.767795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.768214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.781366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:25.782974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:25.805592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:25.806777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:25.807893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:25.807893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:25.807893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:25.807893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:25.809431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 350/688] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:25.815320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:25.855425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe80dd-7462-4139-bff3-1b9500573b44 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:25.922942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:25.924248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:25.925075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:25.925585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:25.937527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:25.946180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:25.947291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:25.948280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:25.950508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 339/689] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:25.960113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:25.965419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:26.005273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89ca3-15a3-4ae4-83b4-4c2f189c0184 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.063812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.064491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.064818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.065094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.065822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:26.066124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.067527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.088092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 351/690] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:26.094051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.110777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:26.121151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfa70c-ba52-45c5-a51e-b749e586dea8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.155404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4170663-ddcd-458c-88f0-fa07230cdc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.156150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4170663-ddcd-458c-88f0-fa07230cdc74 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.156466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4170663-ddcd-458c-88f0-fa07230cdc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.156734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4170663-ddcd-458c-88f0-fa07230cdc74 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.157491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4170663-ddcd-458c-88f0-fa07230cdc74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:26.157794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4170663-ddcd-458c-88f0-fa07230cdc74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.159206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4170663-ddcd-458c-88f0-fa07230cdc74 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.168158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 340/691] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:26.169471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449e603-777c-473c-b2b3-ecd09ca5d1e1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.169753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449e603-777c-473c-b2b3-ecd09ca5d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.170025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449e603-777c-473c-b2b3-ecd09ca5d1e1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.171777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 341/692] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:26.174813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449e603-777c-473c-b2b3-ecd09ca5d1e1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.232000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d9ff3-8764-4b87-b64a-f76ac79f19dc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.268341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db539e67-74c5-4deb-b225-f1c87e768b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.269150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db539e67-74c5-4deb-b225-f1c87e768b8c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.269476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db539e67-74c5-4deb-b225-f1c87e768b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.269751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db539e67-74c5-4deb-b225-f1c87e768b8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.278506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db539e67-74c5-4deb-b225-f1c87e768b8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.281154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db539e67-74c5-4deb-b225-f1c87e768b8c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.281846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:26.300218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449e603-777c-473c-b2b3-ecd09ca5d1e1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-db539e67-74c5-4deb-b225-f1c87e768b8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:26.303545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:26.304500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:26.305406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:26.308463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 352/693] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:26.318564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53efe0-3abc-4e71-9b95-2fcf6dbbce89 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.318564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53efe0-3abc-4e71-9b95-2fcf6dbbce89 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.318564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53efe0-3abc-4e71-9b95-2fcf6dbbce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.338539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7b53efe0-3abc-4e71-9b95-2fcf6dbbce89 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:26.340105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b53efe0-3abc-4e71-9b95-2fcf6dbbce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:26.342248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.344218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.344505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.344780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.357029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.359484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.371107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:26.383475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:26.384589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:26.385601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:26.385601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:26.385601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:26.385601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:26.390584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 342/694] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:26.390584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.425131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 353/695] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:26.426223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53efe0-3abc-4e71-9b95-2fcf6dbbce89 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.530965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670f896-8495-40e4-83d8-cde801e6f2fa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.549326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53efe0-3abc-4e71-9b95-2fcf6dbbce89 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.576826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:26.584630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.585675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.586064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.586429 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.586762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.587043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.587314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.587535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.588045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:26.588350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.588916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:26.589417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.589728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.591575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.606345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 354/696] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:26.606345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.615018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 343/697] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:26.616399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.696089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:26.710550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a826be-7ceb-4d66-b2df-202b889b8847 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.745082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93072ff3-3550-4cd3-ae05-7c89252f3f12 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.756538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.757767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.758149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.758580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.759606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.761684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:26.778327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:26.779337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:26.780223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:26.783161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 355/698] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:26.784182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.792874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.793706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.793994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.794271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.804578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.806785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:26.825942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:26.827395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:26.828344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:26.830431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 344/699] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:26.831503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.848507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:26.903491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd84cf1-4c17-413a-9d6e-caf615847c9a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.942839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:26.943887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:26.944366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:26.944834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:26.945868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5731c3ee4a284ae085eedd600c21bc39) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:26.946484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:26.948138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:26.955537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 356/700] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/role_assignments?user.id=5731c3ee4a284ae085eedd600c21bc39&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:26.956692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:26.974121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574bf31-f163-4d04-9312-5edf2c83666a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:26.997628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:27.016882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:27.017987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.018507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.018984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.019992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:27.020571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:27.022335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:27.028432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 345/701] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:27.039186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:27.130904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bef98e-858c-459b-9621-e07a30faf9de None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:27.170664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:27.183170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6731a-4f26-418e-900b-c3bd33b49a76 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:27.186640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:27.187332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.187609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.187881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.188721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:27.189027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:27.190475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:27.211222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 357/702] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:14:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:27.217852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:27.225746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b9d15-1357-4abf-886e-9cf00b30d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:27.226603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b9d15-1357-4abf-886e-9cf00b30d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.226977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b9d15-1357-4abf-886e-9cf00b30d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.227339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b9d15-1357-4abf-886e-9cf00b30d0d6 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.228146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b9d15-1357-4abf-886e-9cf00b30d0d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:27.228557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b9d15-1357-4abf-886e-9cf00b30d0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:27.230565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b9d15-1357-4abf-886e-9cf00b30d0d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:27.238553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 346/703] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Jul 12 17:14:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:27.335407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6390e-45ae-461f-9e2e-90d89b92accc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:27.373629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:27.374410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.374695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.374968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.419529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:27.449133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:27.450617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:27.480537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e06bd7-aafc-4ef1-b4e4-fec044711a35 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.480869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e06bd7-aafc-4ef1-b4e4-fec044711a35 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.481044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e06bd7-aafc-4ef1-b4e4-fec044711a35 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.486233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 347/704] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:14:27.488819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12122312-082d-4220-8139-37a0cdf2c4f8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.489007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12122312-082d-4220-8139-37a0cdf2c4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.489315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12122312-082d-4220-8139-37a0cdf2c4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.513687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-12122312-082d-4220-8139-37a0cdf2c4f8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:27.516344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-12122312-082d-4220-8139-37a0cdf2c4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:27.573296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 358/705] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:27.583286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:27.584636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:27.613724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 348/706] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:27.650417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12122312-082d-4220-8139-37a0cdf2c4f8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:27.765211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12122312-082d-4220-8139-37a0cdf2c4f8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:27.792140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:27.807022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:27.808255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.808754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.809276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.821239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:27.823234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:27.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:27.844123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:27.845014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:27.845014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:27.845014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:27.845014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:27.847306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 349/707] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:27.855884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:27.881742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35757291-8623-4788-ab5c-f533e2bd0910 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:27.915369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:27.931311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e199590-f81a-4d09-a446-b6e5d61dae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:27.932119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199590-f81a-4d09-a446-b6e5d61dae28 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.932400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199590-f81a-4d09-a446-b6e5d61dae28 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.932673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199590-f81a-4d09-a446-b6e5d61dae28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.943271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e199590-f81a-4d09-a446-b6e5d61dae28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:27.944729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e199590-f81a-4d09-a446-b6e5d61dae28 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2e199590-f81a-4d09-a446-b6e5d61dae28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:27.963201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:27.964190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:27.965117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:27.965117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:27.965117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:27.965117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:27.965117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 359/708] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:27.970227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d40d9-0b71-46f1-be48-a1d5b56d6260 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:27.970227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d40d9-0b71-46f1-be48-a1d5b56d6260 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:27.970227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d40d9-0b71-46f1-be48-a1d5b56d6260 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:27.970227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 360/709] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:27.971194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d40d9-0b71-46f1-be48-a1d5b56d6260 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.001092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab52a7-8a84-4484-809e-dc3693c1f690 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.039756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d37f4-0360-43e4-8f67-2d3da5bf626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.040358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d37f4-0360-43e4-8f67-2d3da5bf626d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.040689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d37f4-0360-43e4-8f67-2d3da5bf626d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.040969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d37f4-0360-43e4-8f67-2d3da5bf626d None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.041894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d37f4-0360-43e4-8f67-2d3da5bf626d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:28.042584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d37f4-0360-43e4-8f67-2d3da5bf626d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.044853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d37f4-0360-43e4-8f67-2d3da5bf626d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.059269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 350/710] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:28.060624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513bce-2f24-482b-a7c2-d2a8fc26c9b5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.060957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513bce-2f24-482b-a7c2-d2a8fc26c9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.061402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4513bce-2f24-482b-a7c2-d2a8fc26c9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.079231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d40d9-0b71-46f1-be48-a1d5b56d6260 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.079834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d4513bce-2f24-482b-a7c2-d2a8fc26c9b5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:28.081157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4513bce-2f24-482b-a7c2-d2a8fc26c9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:28.103245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:28.115030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.116050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.116336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.116860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.117620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:28.118321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.119964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.135089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 361/711] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:28.136271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.174311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 351/712] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:28.174311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4513bce-2f24-482b-a7c2-d2a8fc26c9b5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.203864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:28.266355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce6f3d-516d-48fa-bd8f-13fcf9ae488a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.302393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.303488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.303990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.304486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.305385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.307332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.313524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4513bce-2f24-482b-a7c2-d2a8fc26c9b5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.332426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 362/713] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:14:28 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:28.333729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.380956 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.381794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.382078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.385888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.403137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.404738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:28.433687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:28.434723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:28.435696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:28.438472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:28.445585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 352/714] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:28.464284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.542856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb5e39-5964-47d1-b29c-c7f3c689e6e3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.583206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.584022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.584307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.584578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.585243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.586653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.594623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:28.599051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:28.601605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:28.602985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 363/715] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:28 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:28.606833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.621389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5c5ac-28eb-450b-b871-0d8c99a90bad None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.663082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.664167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.664646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.665258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.666312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:28.666842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.668526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.683502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 353/716] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:28.689584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.722444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078863-968d-4c0e-8df2-f7bf0183358a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.725132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:28.763897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.764944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.765344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.765611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.767483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:28.767483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.768628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.773737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 364/717] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:28.779415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:28.841847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef4df9-b26d-4dc1-8e26-26fe1e7dfd2f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.878731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520ed01-46ad-49d0-ba65-a61857da3a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.879407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520ed01-46ad-49d0-ba65-a61857da3a06 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.879804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520ed01-46ad-49d0-ba65-a61857da3a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.880084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520ed01-46ad-49d0-ba65-a61857da3a06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.881039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520ed01-46ad-49d0-ba65-a61857da3a06 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5253b3eec6ae45f3bca9369107c4d93a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:28.881355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520ed01-46ad-49d0-ba65-a61857da3a06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.883037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520ed01-46ad-49d0-ba65-a61857da3a06 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.889697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 354/718] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:28 2022] GET /identity/v3/role_assignments?user.id=5253b3eec6ae45f3bca9369107c4d93a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:28.923004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfb5ae-a018-4792-a0fc-14de50a86871 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:28.972456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c8137-a6fb-4b08-8305-3dc6ad6c73d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:28.973182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8137-a6fb-4b08-8305-3dc6ad6c73d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:28.973463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8137-a6fb-4b08-8305-3dc6ad6c73d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:28.973731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c8137-a6fb-4b08-8305-3dc6ad6c73d2 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:28.974499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c8137-a6fb-4b08-8305-3dc6ad6c73d2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:28.974802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c8137-a6fb-4b08-8305-3dc6ad6c73d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:28.976171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c8137-a6fb-4b08-8305-3dc6ad6c73d2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:28.982441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 365/719] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:29.490220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce086-3ad8-4119-92a9-d408736ace45 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:29.491138 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce086-3ad8-4119-92a9-d408736ace45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:29.491216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ce086-3ad8-4119-92a9-d408736ace45 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:29.492848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 355/720] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:29.497934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c69e8-20ab-48d2-875e-99dba0a32068 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:29.498227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c69e8-20ab-48d2-875e-99dba0a32068 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:29.498602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c69e8-20ab-48d2-875e-99dba0a32068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:29.518391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-824c69e8-20ab-48d2-875e-99dba0a32068 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:29.519598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-824c69e8-20ab-48d2-875e-99dba0a32068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:29.556671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:29.616989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 366/721] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:29.660696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce086-3ad8-4119-92a9-d408736ace45 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:29.668339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:29.730634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b34d32-68f3-4601-b10c-0addca4132a6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:29.730974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b34d32-68f3-4601-b10c-0addca4132a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:29.731205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b34d32-68f3-4601-b10c-0addca4132a6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:29.733972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 367/722] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:29.745277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9ef2-f623-468d-abee-56ebf35cc7f5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:29.745532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9ef2-f623-468d-abee-56ebf35cc7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:29.746012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b9ef2-f623-468d-abee-56ebf35cc7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:29.767556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7d1b9ef2-f623-468d-abee-56ebf35cc7f5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:29.768761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7d1b9ef2-f623-468d-abee-56ebf35cc7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:29.828127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ce086-3ad8-4119-92a9-d408736ace45 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:29.878241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:29.879287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 368/723] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:29.879533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:29.880040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:29.880534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:29.881452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:29.883046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:29.904449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b9ef2-f623-468d-abee-56ebf35cc7f5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:29.914177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 356/724] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:14:29 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:30.046201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:30.056022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b9ef2-f623-468d-abee-56ebf35cc7f5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:30.129295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:30.130125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:30.130444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:30.130721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:30.155127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:30.163377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:30.164396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:30.165225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 369/725] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:30.172943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:30.244179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:30.285800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ca07a-30c8-4ee1-a057-f4a1c9ecd07d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:30.321459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:30.322153 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:30.322475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:30.322750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:30.323515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:30.323916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:30.325493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:30.335736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 357/726] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:30.341672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:30.454866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04405342-8eb2-453e-96fa-234122557f1e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:30.488412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:30.489210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:30.489486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:30.489755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:30.501821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:30.503332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:30.511650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:30.521509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:30.522964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:30.523993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:30.523993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:30.523993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:30.523993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:30.523993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 370/727] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:30.529207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:30.698500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3929-279e-4f3f-b7fb-48a75bfe6788 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:30.739666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:30.749104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:30.750435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:30.751108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:30.751647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:30.752743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:30.753051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:30.754571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:30.767273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 358/728] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:30.775595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:30.897573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b7b0-9918-4ca2-806e-f6b4b2f6cf14 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:30.942433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7388972-10db-4ecd-a74b-b436b7605139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:30.943251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7388972-10db-4ecd-a74b-b436b7605139 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:30.943530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7388972-10db-4ecd-a74b-b436b7605139 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:30.943797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7388972-10db-4ecd-a74b-b436b7605139 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:30.955377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7388972-10db-4ecd-a74b-b436b7605139 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:30.956962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7388972-10db-4ecd-a74b-b436b7605139 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c7388972-10db-4ecd-a74b-b436b7605139 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:30.972663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:30.974614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:30.976286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:30.980348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 371/729] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:30.981635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:31.015659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43695ce2-3df2-42db-a4e3-d363ef632d4c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.015945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43695ce2-3df2-42db-a4e3-d363ef632d4c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.016351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43695ce2-3df2-42db-a4e3-d363ef632d4c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.018680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 372/730] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:31.023865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b0b91-fb7a-43ce-96f3-7a451d846bcb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.024213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b0b91-fb7a-43ce-96f3-7a451d846bcb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.024491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b0b91-fb7a-43ce-96f3-7a451d846bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.042594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5d9b0b91-fb7a-43ce-96f3-7a451d846bcb None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:31.043799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d9b0b91-fb7a-43ce-96f3-7a451d846bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:31.148123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:31.160056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 373/731] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 17:14:31.183302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc423ff-176e-47f6-a392-c01fd151557a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:31.199533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b0b91-fb7a-43ce-96f3-7a451d846bcb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:31.263090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:31.263799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.264276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.264574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.265644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:31.265960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:31.267476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:31.316189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 359/732] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Jul 12 17:14:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:31.322687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:31.406449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:31.470276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ec3a1-2e46-43d8-8ba7-f700c4cb255a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:31.484548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b0b91-fb7a-43ce-96f3-7a451d846bcb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:31.513694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c990-453b-412a-abb7-d416b0db81ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:31.514442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c990-453b-412a-abb7-d416b0db81ca None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.514726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c990-453b-412a-abb7-d416b0db81ca None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.515139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c990-453b-412a-abb7-d416b0db81ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.538856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c25bb-f006-41d5-8b0d-372d015f5680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:31.540025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c25bb-f006-41d5-8b0d-372d015f5680 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.542489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c25bb-f006-41d5-8b0d-372d015f5680 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.542986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c25bb-f006-41d5-8b0d-372d015f5680 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.556457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c25bb-f006-41d5-8b0d-372d015f5680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7e4c25bb-f006-41d5-8b0d-372d015f5680 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:31.569111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:31.570079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:31.571316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:31.574080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 374/733] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:31.575644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948d8a1-1211-4c9d-8f93-9dfd54166db6 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.576133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948d8a1-1211-4c9d-8f93-9dfd54166db6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.576654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948d8a1-1211-4c9d-8f93-9dfd54166db6 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.578684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 375/734] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:31.589783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29978cf-c404-4248-a0f5-c5d22d4904bf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.590096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29978cf-c404-4248-a0f5-c5d22d4904bf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.590357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29978cf-c404-4248-a0f5-c5d22d4904bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.603246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156c990-453b-412a-abb7-d416b0db81ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:31.605837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156c990-453b-412a-abb7-d416b0db81ca None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:31.622373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b29978cf-c404-4248-a0f5-c5d22d4904bf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:31.624738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b29978cf-c404-4248-a0f5-c5d22d4904bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:31.665573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:31.694723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:31.723748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 376/735] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:31.724630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29978cf-c404-4248-a0f5-c5d22d4904bf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:31.752647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 360/736] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:31 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 17:14:31.754551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64aae-d1f0-454d-a59d-e6a84af31252 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.755125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64aae-d1f0-454d-a59d-e6a84af31252 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.755619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64aae-d1f0-454d-a59d-e6a84af31252 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.757250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 361/737] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:31.758337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64aae-d1f0-454d-a59d-e6a84af31252 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:31.836600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29978cf-c404-4248-a0f5-c5d22d4904bf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:31.874346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:31.875048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.875321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.875595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.876358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:31.876664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:31.878082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:31.885591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64aae-d1f0-454d-a59d-e6a84af31252 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:31.891591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 377/738] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:31.891591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:31.932633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e46721-4b5b-4382-9d69-9f6962707cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:31.933358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46721-4b5b-4382-9d69-9f6962707cda None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.933645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46721-4b5b-4382-9d69-9f6962707cda None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.933920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46721-4b5b-4382-9d69-9f6962707cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.937888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:31.948875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e46721-4b5b-4382-9d69-9f6962707cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f9e46721-4b5b-4382-9d69-9f6962707cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:31.957487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:31.958499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:31.959367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:31.960167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 362/739] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:31.961175 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904fb46-64c6-441b-9cea-f3f8d80c9ab5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:31.961466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904fb46-64c6-441b-9cea-f3f8d80c9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:31.961742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904fb46-64c6-441b-9cea-f3f8d80c9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:31.969358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:31.982769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3904fb46-64c6-441b-9cea-f3f8d80c9ab5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:31.985338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3904fb46-64c6-441b-9cea-f3f8d80c9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:32.011966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b83ae-cda5-46b1-bbeb-f4f8faeb084e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.055655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.056603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.056887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.057163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.060310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 363/740] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 17:14:32.061615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904fb46-64c6-441b-9cea-f3f8d80c9ab5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.073336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.075116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:32.093815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:32.094836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:32.095719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:32.095719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:32.095719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:32.095719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:32.095719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 378/741] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:32.096003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.198755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904fb46-64c6-441b-9cea-f3f8d80c9ab5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.203453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:32.210408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaddb2-28a3-46db-8252-8f8d4605072a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.235511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.236317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.236610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.236886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.238846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:32.248646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.248809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.249353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.249632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.249901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.250106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.250725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:32.250989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.252456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.261483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 379/742] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:32.266727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:32.268412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:32.269268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:32.270735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:32.270735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:32.270735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:32.270735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:32.270735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 364/743] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:32.270735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.377022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ea051-f010-45ef-9afe-e8d1190d88b7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.378781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b807a4e9-0b83-4fd1-8183-273f4f7316f0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.411639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.412319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.412600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.412874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.413601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:32.413910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.415135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.415354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.415809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.416110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.416356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.417076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.418677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.429020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 365/744] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:32.429935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.442595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 380/745] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:14:32 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:32.444577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.489250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:32.489456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:32.555467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad28538-c155-49d9-830e-f744adde56f8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.603608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270691b-dc87-4891-9389-caa3177a4eba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.614560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.615392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.616034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.616308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.629160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.630657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.648693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:32.648893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:32.649724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:32.650698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:32.650698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:32.650698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:32.650698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:32.650916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.650916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.650916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.651103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 366/746] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:32.651170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:32.651170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.651296 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.652543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.671435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 381/747] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:32.671435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.756432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:32.768045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:32.772558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c931cce-8b5a-4751-9bc7-c17cceb48993 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.787836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825ca53-299a-4bfd-ae2f-7ba3dd9c0fce None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.812882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.813754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.814043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.814613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.821786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.823286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.825459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d5912-a93c-461a-b6c6-5b4de05b63c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:32.826144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5912-a93c-461a-b6c6-5b4de05b63c5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.826477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5912-a93c-461a-b6c6-5b4de05b63c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.826784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d5912-a93c-461a-b6c6-5b4de05b63c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.827509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d5912-a93c-461a-b6c6-5b4de05b63c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:32.827815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d5912-a93c-461a-b6c6-5b4de05b63c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:32.829180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d5912-a93c-461a-b6c6-5b4de05b63c5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:32.837676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:32.838654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:32.839646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 367/748] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:32.840133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.846529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 382/749] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:32.847852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d4b3-f402-444f-aa71-3fb5d7ddb79f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:32.848141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d4b3-f402-444f-aa71-3fb5d7ddb79f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:32.848419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53d4b3-f402-444f-aa71-3fb5d7ddb79f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:32.849776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 383/750] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:32.854270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d4b3-f402-444f-aa71-3fb5d7ddb79f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:32.958557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30027bf-4475-4ad7-9ff0-59d5f8064476 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:32.964505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53d4b3-f402-444f-aa71-3fb5d7ddb79f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.000439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:33.006669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.007281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.007560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.007829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.008655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:33.008966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.010483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.029791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 384/751] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:33.029791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.118441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa291068-723c-450b-8733-ba44220c99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.119266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291068-723c-450b-8733-ba44220c99a9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.119549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291068-723c-450b-8733-ba44220c99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.119821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa291068-723c-450b-8733-ba44220c99a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.127221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa291068-723c-450b-8733-ba44220c99a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.128676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa291068-723c-450b-8733-ba44220c99a9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.139618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ab646-8ffa-466a-9b56-805313783ade None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-aa291068-723c-450b-8733-ba44220c99a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:33.143331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:33.144231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:33.145195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:33.149256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 368/752] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:14:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:33.150574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca4bba-b668-4ec4-8951-2ab14b4a1b36 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.150893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca4bba-b668-4ec4-8951-2ab14b4a1b36 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.151166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca4bba-b668-4ec4-8951-2ab14b4a1b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.168055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c9ca4bba-b668-4ec4-8951-2ab14b4a1b36 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:33.169256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c9ca4bba-b668-4ec4-8951-2ab14b4a1b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:33.175457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.176263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.176543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.176820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.183632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:33.184572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.186512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:33.201516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:33.202767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 385/753] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:33.203712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.247662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 369/754] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:33.251471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca4bba-b668-4ec4-8951-2ab14b4a1b36 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.260376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:33.311183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e9839-278e-4fc7-9e28-4fa8a8478b5b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.346130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.346872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.347166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.347435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.348316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5731c3ee4a284ae085eedd600c21bc39) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:33.348634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.350063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.355549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 386/755] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/role_assignments?user.id=5731c3ee4a284ae085eedd600c21bc39&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:33.356323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.380194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca4bba-b668-4ec4-8951-2ab14b4a1b36 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.420816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.421652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.422111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.422516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.423470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:33.423898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.425652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.456806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 370/756] 10.222.0.50 () {56 vars in 1149 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:33.456806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.465450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:33.482545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff596ef3-5155-4276-82a0-5adde88cd00e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.504544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:33.525873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.526920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.527345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.527746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.528787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:33.529245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.531403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.552636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 387/757] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:33.553727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.600624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cac46-9d3b-430e-a054-dd2b2d7960f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.654777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.657075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.657388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.658026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.658903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.661784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:33.680352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:33.681626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:33.682618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:33.683641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce559e8c-f826-4ca9-921b-0c5238341945 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.683715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 371/758] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:33.683715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.725215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.726061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.726479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.726866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.773862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:33.778566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:33.806451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3abb4e-cad9-43d8-9e7c-2de8279c8d40 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:33.809777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.811639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.846477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:33.847330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:33.848328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:33.848328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:33.863726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:33.866145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:33.888903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:33.890042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:33.890998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:33.890998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:33.890998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:33.890998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:33.893638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 372/759] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:33.894690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:33.934326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 388/760] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:14:33.934326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.025829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:34.039865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ac741-1b1a-4d4c-8755-b1e24aadf7e0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.057115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cd56-9e04-45fd-8b6a-0f0c344c00ed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.074144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:34.092559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.094374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.095150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.095748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.096668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:34.097170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.098973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.099083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.099657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.099942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.100210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.100929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:34.101233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.103111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.106713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 373/761] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:34.107919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.122313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 389/762] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:34.123252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.240527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0007dd-7e8c-490f-8e7e-e1573e6dbc16 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.247147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b55d0-e872-40f2-bd7c-1d89fed4aad0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.287371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.287842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.288197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.288568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.288900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.289416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.289731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:34.290115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.290217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.290682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.291614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.293062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:34.298345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 390/763] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:34.299369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.310910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.312652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:34.334512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:34.335568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:34.336472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:34.336472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:34.336472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:34.336472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:34.338327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 374/764] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:34.338461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.399720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:34.438168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed7d7d-83a8-48f6-9886-f34758b5e332 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.483107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc30396-d022-44d0-b6be-4a65e93893f8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.495495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.496785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.497080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.497361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.507548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.509907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:34.528021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:34.528980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:34.529976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:34.530970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.531860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.532280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.532703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.533646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] RBAC: Adding query filter params (interface=public, service_id=2681cb73f6a14e7a901da00619079f85, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:34.534113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.534331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 391/765] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:34.535204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.536095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.549662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 375/766] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/endpoints?service_id=2681cb73f6a14e7a901da00619079f85&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:34.550909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.602845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:34.649052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5e57f-735f-4522-beb7-87698b1e309e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.664528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8dcb26-11e0-49bb-b680-7755e53d12a9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.666623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:34.687445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.688125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.688400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.688676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.689394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:34.689692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.691114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.707062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 392/767] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:34.707062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.709571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298663ee-ca86-4fa2-b95b-ad96b3b69193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.710251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298663ee-ca86-4fa2-b95b-ad96b3b69193 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.710574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298663ee-ca86-4fa2-b95b-ad96b3b69193 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.711504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298663ee-ca86-4fa2-b95b-ad96b3b69193 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.711630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298663ee-ca86-4fa2-b95b-ad96b3b69193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:34.711938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298663ee-ca86-4fa2-b95b-ad96b3b69193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.713389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298663ee-ca86-4fa2-b95b-ad96b3b69193 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.731173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 376/768] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:34.731173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75366b4-3ce2-48d3-b918-39dda3136e13 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.731173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75366b4-3ce2-48d3-b918-39dda3136e13 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.731173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75366b4-3ce2-48d3-b918-39dda3136e13 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.731173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 377/769] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:34.731173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75366b4-3ce2-48d3-b918-39dda3136e13 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.822887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b65a98-f2ab-4606-8d30-823932077b8a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.839910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75366b4-3ce2-48d3-b918-39dda3136e13 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:34.840720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:34.860395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.861325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.862194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.862677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.863560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.865107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.871449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 393/770] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:34.872334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:34.884710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cdcd7-d819-4d30-8033-8abe54537abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:34.885726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cdcd7-d819-4d30-8033-8abe54537abe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.886099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cdcd7-d819-4d30-8033-8abe54537abe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.886502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cdcd7-d819-4d30-8033-8abe54537abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.897509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cdcd7-d819-4d30-8033-8abe54537abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:34.899983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cdcd7-d819-4d30-8033-8abe54537abe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ce6cdcd7-d819-4d30-8033-8abe54537abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:34.921266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:34.922269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:34.923222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:34.926730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 378/771] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:34.928520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273113-ea71-41ff-b936-62684b61a118 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:34.929047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273113-ea71-41ff-b936-62684b61a118 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:34.929528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a273113-ea71-41ff-b936-62684b61a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:34.948236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2a273113-ea71-41ff-b936-62684b61a118 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:34.949978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a273113-ea71-41ff-b936-62684b61a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:34.974320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:35.003352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edab56c-4179-462b-9895-2b6e9d263100 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:35.047049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 379/772] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:35.048793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273113-ea71-41ff-b936-62684b61a118 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:35.049582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:35.051437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.051881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.052155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5253b3eec6ae45f3bca9369107c4d93a/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.056230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=5253b3eec6ae45f3bca9369107c4d93a, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:35.057799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:35.082054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 394/773] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:34 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5253b3eec6ae45f3bca9369107c4d93a/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:35.083347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:35.145805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:35.217956 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a273113-ea71-41ff-b936-62684b61a118 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:35.265024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e7205-cc05-4b35-97bc-9ad55ed0d103 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:35.284299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:35.284977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.285252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.285521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.286330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:35.286637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:35.288084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:35.301246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 380/774] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:35.309339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:35.314276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:35.315116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.315919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.315919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] PATH_INFO: `/v3/services/network` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.316326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:35.323301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:35.331472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:35.337199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:35.338391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:35.339582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:35.342488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 395/775] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:35.352374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:35.477140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b27a8e-f099-4339-abfc-467ed6f5b9c8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:35.514730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcdf5a-e35c-4294-b5e3-3e9bda70570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:35.515110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcdf5a-e35c-4294-b5e3-3e9bda70570a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.515397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcdf5a-e35c-4294-b5e3-3e9bda70570a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.515675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcdf5a-e35c-4294-b5e3-3e9bda70570a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.516514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcdf5a-e35c-4294-b5e3-3e9bda70570a None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=c2841ffed5bb4257b20a5e88271d6979) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:35.516826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcdf5a-e35c-4294-b5e3-3e9bda70570a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:35.517547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aaec4-2525-4ec3-a551-e75e177d10de None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:35.518396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dcdf5a-e35c-4294-b5e3-3e9bda70570a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:35.524994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:35.525828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 381/776] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/role_assignments?user.id=c2841ffed5bb4257b20a5e88271d6979&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:35.527307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8fa8-68c1-4562-b9ec-d016b4405322 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.527597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8fa8-68c1-4562-b9ec-d016b4405322 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.527874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8fa8-68c1-4562-b9ec-d016b4405322 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.529589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 382/777] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:35.535203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6caeb-26e4-4927-b027-0f53e7edbc11 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.535520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6caeb-26e4-4927-b027-0f53e7edbc11 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.535767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6caeb-26e4-4927-b027-0f53e7edbc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.553951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60d6caeb-26e4-4927-b027-0f53e7edbc11 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:35.555210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60d6caeb-26e4-4927-b027-0f53e7edbc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:35.588652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:35.589264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.589546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.589816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.590571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:35.590878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:35.593067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:35.600046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 396/778] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:35.605481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:35.690007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 383/779] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:35.752508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6caeb-26e4-4927-b027-0f53e7edbc11 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:35.762109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:35.778583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e6ed1-3dba-4ca0-9a56-aa1c935ddfc8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:35.856939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:35.857524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.857869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.858149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.858859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] RBAC: Adding query filter params (type=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:35.859162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:35.860547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:35.871893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 397/780] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:35.883270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:35.915917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6caeb-26e4-4927-b027-0f53e7edbc11 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:35.950096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:35.951013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:35.951293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:35.951636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:35.962071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:35.965079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:35.971431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:35.972370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:35.973366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 384/781] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:35.983644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:36.076249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd1cd6-0add-4c33-84a8-718ec0e3f271 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:36.090685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:36.132815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:36.133412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:36.133692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:36.133963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:36.134804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] RBAC: Adding query filter params (interface=public, service_id=505af0fd83564672b85745bdf90fb8e3, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:36.135111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:36.136552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:36.151769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 398/782] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/endpoints?service_id=505af0fd83564672b85745bdf90fb8e3&interface=public®ion_id=RegionOne => generated 194 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:36.156355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58579675-acdf-4b8f-8386-c1c3b4fd8722 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:36.158759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:36.233237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:36.233943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:36.234225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:36.234525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:36.235297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:36.235602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:36.237006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:36.254899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 385/783] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:36.261234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:36.318580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e45675-760a-403c-a301-18dffdadca13 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:36.322659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:36.354605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:36.355382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:36.355665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:36.355936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:36.356619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:36.358064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:36.364194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 399/784] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:14:36 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:36.477149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae388-3282-4ff6-85f7-3a7994d625e5 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:36.510947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:36.513947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:36.514990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:36.515275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:36.515557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:36.527031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:36.528578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:36.547521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:36.548502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:36.549637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:36.549637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:36.549637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:36.549637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:36.549637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 386/785] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:36.556116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:36.689730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916eaf-1c31-4087-a615-dff7971bad78 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:36.723914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:36.724588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:36.724866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:36.725139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:36.725866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:36.726171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:36.727639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:36.741008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 400/786] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:36.746939 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:36.851051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fa253-3c30-4a04-9874-f62493371c05 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:36.900237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:36.901413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:36.901886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:36.902354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:36.914260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:36.916020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:36.931616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:36.932622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:36.933588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:36.940514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 387/787] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:36.942064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:36.975938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:37.055800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5586-2e40-4a7a-b3f9-766519a40083 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:37.099797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:37.100558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.100758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.101031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.101880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:37.102190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:37.103668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:37.128723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 401/788] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Jul 12 17:14:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:37.134447 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:37.192775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:37.267471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719889-04b6-4195-b58d-428fdc43c93a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:37.309365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45b89f-efd9-4a48-8150-6bee219bfbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:37.310193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b89f-efd9-4a48-8150-6bee219bfbef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.310500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b89f-efd9-4a48-8150-6bee219bfbef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.310815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45b89f-efd9-4a48-8150-6bee219bfbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.322268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45b89f-efd9-4a48-8150-6bee219bfbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:37.323764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45b89f-efd9-4a48-8150-6bee219bfbef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ce45b89f-efd9-4a48-8150-6bee219bfbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:37.352131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:37.353173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:37.354068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:37.354068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:37.354068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:37.354068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:37.354068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 388/789] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:37.360272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:37.412655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2ce47-0bd3-46ce-add9-79684e6e1cd8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.412983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2ce47-0bd3-46ce-add9-79684e6e1cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.413216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2ce47-0bd3-46ce-add9-79684e6e1cd8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.414894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 389/790] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:37.419850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1866e-cfef-4310-9ad7-4720c1fe5374 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.420223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1866e-cfef-4310-9ad7-4720c1fe5374 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.420616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1866e-cfef-4310-9ad7-4720c1fe5374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.451383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60c1866e-cfef-4310-9ad7-4720c1fe5374 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:37.452793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60c1866e-cfef-4310-9ad7-4720c1fe5374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:37.474659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:37.499996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c8ac-ae4f-4818-b6fb-758676b7cfc0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:37.545224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852bb67d-6270-4806-b108-14c83bfcfd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:37.546013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb67d-6270-4806-b108-14c83bfcfd27 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.546387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb67d-6270-4806-b108-14c83bfcfd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.546724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852bb67d-6270-4806-b108-14c83bfcfd27 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.547764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb67d-6270-4806-b108-14c83bfcfd27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:37.548186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb67d-6270-4806-b108-14c83bfcfd27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:37.549964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852bb67d-6270-4806-b108-14c83bfcfd27 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:37.569401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 402/791] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:37.569401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694410e-a7a3-43f3-831f-692bb07e0fee None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.569401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694410e-a7a3-43f3-831f-692bb07e0fee None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.569401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694410e-a7a3-43f3-831f-692bb07e0fee None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.569401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 403/792] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:37.571056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 390/793] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:37.579394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694410e-a7a3-43f3-831f-692bb07e0fee None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:37.581665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a915176-bf93-4b0d-9da3-f8d84849d6a2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.582106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a915176-bf93-4b0d-9da3-f8d84849d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.582565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a915176-bf93-4b0d-9da3-f8d84849d6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.613599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1a915176-bf93-4b0d-9da3-f8d84849d6a2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:37.614819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1a915176-bf93-4b0d-9da3-f8d84849d6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:37.638695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:37.704488 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 391/794] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:37.705703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a915176-bf93-4b0d-9da3-f8d84849d6a2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:37.742614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694410e-a7a3-43f3-831f-692bb07e0fee None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:37.790322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:37.791991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.792267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.792544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.801831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:37.805524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:37.808792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:37.824767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:37.825671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:37.826697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:37.827132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a915176-bf93-4b0d-9da3-f8d84849d6a2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:37.834061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 404/795] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:37.835190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:37.871904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:37.872733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.873004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.873307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.887442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:37.896377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:37.897308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:37.898154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 392/796] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:37.898872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:37.913966 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:37.945517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b52faa-0fb1-457d-870b-a1d382bcf2c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:37.991916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0eda4-7b65-479d-8205-4e14adfbf75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:37.992722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0eda4-7b65-479d-8205-4e14adfbf75e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:37.993005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0eda4-7b65-479d-8205-4e14adfbf75e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:37.993278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0eda4-7b65-479d-8205-4e14adfbf75e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:37.993918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0eda4-7b65-479d-8205-4e14adfbf75e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:37.995340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0eda4-7b65-479d-8205-4e14adfbf75e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.003697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840095fa-4759-45db-9860-00c8de79f922 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-82c0eda4-7b65-479d-8205-4e14adfbf75e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:38.007469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:38.008384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:38.015127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 405/797] 10.222.0.50 () {56 vars in 1129 bytes} [Tue Jul 12 17:14:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:38.016753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390f93-6da6-4eca-b05b-693710e5354c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.016753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390f93-6da6-4eca-b05b-693710e5354c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.016753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2390f93-6da6-4eca-b05b-693710e5354c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.016753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 406/798] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:38.016753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390f93-6da6-4eca-b05b-693710e5354c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.045504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35343e8d-9bf5-4b1e-bc56-562d53ad44fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.046170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35343e8d-9bf5-4b1e-bc56-562d53ad44fb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.046485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35343e8d-9bf5-4b1e-bc56-562d53ad44fb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.046764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35343e8d-9bf5-4b1e-bc56-562d53ad44fb None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.047556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35343e8d-9bf5-4b1e-bc56-562d53ad44fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:38.047864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35343e8d-9bf5-4b1e-bc56-562d53ad44fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.049306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35343e8d-9bf5-4b1e-bc56-562d53ad44fb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.062346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 393/799] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:38.064098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61837f-053c-4e2a-be15-99a2028fc67f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.064389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61837f-053c-4e2a-be15-99a2028fc67f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.064662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61837f-053c-4e2a-be15-99a2028fc67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.081822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cd61837f-053c-4e2a-be15-99a2028fc67f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:38.082949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cd61837f-053c-4e2a-be15-99a2028fc67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:38.087549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.130970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2390f93-6da6-4eca-b05b-693710e5354c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.160388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 394/800] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:38.161580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61837f-053c-4e2a-be15-99a2028fc67f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.164083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.175911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.176595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.176878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.177154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.177909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:38.178246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.179702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.189838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 407/801] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:38.190661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.273450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61837f-053c-4e2a-be15-99a2028fc67f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.295887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90563c74-6d4c-4e8c-adc4-d7e16b48e93b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.309001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.309689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.310248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.310248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.311050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:38.311319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.312687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.317555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 395/802] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:38.318471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.328802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.339004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.340180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.340180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.340391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5731c3ee4a284ae085eedd600c21bc39/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.342638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=5731c3ee4a284ae085eedd600c21bc39, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.344025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.358329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 408/803] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:38 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5731c3ee4a284ae085eedd600c21bc39/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:38.359546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.396212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.436760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe80fa8-7775-48c0-88b2-08513c2b0c12 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.483555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.484953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.485388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.485838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.494843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2af1a2-1dd1-438b-ad6b-6e9ba41420c0 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.500573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:38.509464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:38.510749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:38.511598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:38.514615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 396/804] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:38.515954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.539532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.540383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.540665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.540950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.555516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.557265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:38.587623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:38.588591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:38.589543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:38.589543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:38.589543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:38.589543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:38.596524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 409/805] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:38.596524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.643764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.660201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64a6c6-9f19-444c-9b3d-99c167a053d7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.690096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.701136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.702361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.702645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.702918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.703634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:38.703937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.705321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.711524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 397/806] 10.222.0.50 () {56 vars in 1124 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:38.712331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.720016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8d77e-3967-4b4d-9432-2e45a125e73d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.767812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.769356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.770051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.770527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.771699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:38.772541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.774119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.787309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 410/807] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:38.788401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.831611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf52d8f-6d30-48ae-b707-90dbefc482ab None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.872663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.874033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.874909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.875383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.876356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:38.876856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.878491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.906275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 398/808] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:38.907494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d057e-2f06-4a17-bb0d-7817341206cc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:38.908373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:38.917945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.951667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:38.952345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:38.952629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:38.952909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:38.953658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:38.955090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:38.977377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:38.983675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 411/809] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:14:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:38.984592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.040493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86a01-a2c6-411a-95aa-ec460eb2ecaa None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:39.102990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cc5e2-314e-4db5-8b9e-0455d894c48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:39.103833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc5e2-314e-4db5-8b9e-0455d894c48a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.104120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc5e2-314e-4db5-8b9e-0455d894c48a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.104397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc5e2-314e-4db5-8b9e-0455d894c48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.120193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc5e2-314e-4db5-8b9e-0455d894c48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:39.122029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc5e2-314e-4db5-8b9e-0455d894c48a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:39.127241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad0327-3dcb-4de4-adb3-cedc8f80be13 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8b5cc5e2-314e-4db5-8b9e-0455d894c48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:39.149176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:39.150193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:39.151752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:39.151752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:39.151752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:39.151752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:39.151752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 399/810] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:39.152072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57688e-cff5-4404-acc6-a749e0df8b30 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.152072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57688e-cff5-4404-acc6-a749e0df8b30 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.152329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57688e-cff5-4404-acc6-a749e0df8b30 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.154664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 400/811] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:39.156591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57688e-cff5-4404-acc6-a749e0df8b30 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.170663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c79cf-74b9-48c1-b433-08ea2d96dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:39.172305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c79cf-74b9-48c1-b433-08ea2d96dd8f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.173421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c79cf-74b9-48c1-b433-08ea2d96dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.173874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c79cf-74b9-48c1-b433-08ea2d96dd8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.183041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c79cf-74b9-48c1-b433-08ea2d96dd8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:39.185633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c79cf-74b9-48c1-b433-08ea2d96dd8f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-446c79cf-74b9-48c1-b433-08ea2d96dd8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:39.203700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:39.204678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:14:39.205626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:39.207028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 412/812] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:14:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:39.207757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575cbbc-8be2-4619-b12f-83f94d0fa503 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.208037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575cbbc-8be2-4619-b12f-83f94d0fa503 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.208309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575cbbc-8be2-4619-b12f-83f94d0fa503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.228469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2575cbbc-8be2-4619-b12f-83f94d0fa503 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:39.230111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2575cbbc-8be2-4619-b12f-83f94d0fa503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:39.244063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:39.298979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:39.306076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57688e-cff5-4404-acc6-a749e0df8b30 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:39.335080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 413/813] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:39.336074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575cbbc-8be2-4619-b12f-83f94d0fa503 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.353330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:39.354024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.354315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.354858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.355597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:39.355943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:39.358454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:39.376782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 401/814] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:39.378486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.466852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575cbbc-8be2-4619-b12f-83f94d0fa503 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:39.490433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb106a24-f63f-45b2-9711-ca1d8a7a386f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:39.506784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:39.507723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.508248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.508665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.509754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:39.510210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:39.511834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:39.526706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:39.527670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.528047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.528416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.529256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:39.531087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:39.534320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 414/815] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:14:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:39.535395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.539418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:39.545691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:39.546988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:39.547853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 402/816] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:39 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:39.548690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.578484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:39.669062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5dc5b-9a19-447a-920c-32d33ef17d98 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:39.670891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ae90f-fe54-41e9-905e-f4438b2021c8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:39.710954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:39.711777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.712055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.712324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.716676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:39.717672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:39.718051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:39.718446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:39.720643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:39.722118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:39.800538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:39.802037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:39.838739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:39.858665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:39.861081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 415/817] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:14:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:39.864143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.909279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 403/818] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:14:39.912052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:39.952094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.003950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1cb4c9-29b8-410e-96f5-e4e1f1107b30 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.021142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08d0ca-c37b-4819-b03f-cbcc204acd5c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.044677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.054996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.055671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.055952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.056223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.056942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] RBAC: Adding query filter params (name=network) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:40.057245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.057762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.058579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.058733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.058984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.059325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.060234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:40.060609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.062345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.066475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 416/819] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:40.067318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.085504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 404/820] 10.222.0.50 () {56 vars in 1149 bytes} [Tue Jul 12 17:14:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:40.086391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.194614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaf8a6-e88d-4052-b711-8e4fd875736c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.200177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72babf7e-e1d2-4862-8a84-28aff9544332 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.230712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.231336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.231617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.231895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.232686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] RBAC: Adding query filter params (type=network) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:40.232989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.234504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.234682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.241107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 405/821] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:40.241971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.250326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.251145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.251423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.251700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.263926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.265394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:40.283577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:40.284724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:40.286424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:40.286424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:40.286424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:40.286424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:40.289678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 417/822] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:40.290562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.295268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.355840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39128f55-ce6d-4c64-83f7-7c85df66c9bb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.400271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1e8e4-0d81-44cd-b329-e6379f0852e8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.402017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.403669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.403948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.404223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.416981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.418929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.435453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.436572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.436866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.437149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.437890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.439330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:40.440498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:40.442451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:40.444581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:40.444581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:40.444581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:40.444581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:40.444581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 406/823] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:40.444581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.466529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 418/824] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:14:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:40.468097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.531815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.544893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.551627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294ec05-963c-43ec-b2a1-9338738b1271 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.596410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.596410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.596410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.596989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.597635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:40.598317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.599545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.618735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 407/825] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:40.623987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.677927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9627fa-b532-43cf-a6af-b3671e354631 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.723014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af9ec-62a5-4f27-b3ef-9458f3b6f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.723704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af9ec-62a5-4f27-b3ef-9458f3b6f686 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.724963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af9ec-62a5-4f27-b3ef-9458f3b6f686 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.724963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af9ec-62a5-4f27-b3ef-9458f3b6f686 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.724963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af9ec-62a5-4f27-b3ef-9458f3b6f686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:40.725324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af9ec-62a5-4f27-b3ef-9458f3b6f686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.727758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af9ec-62a5-4f27-b3ef-9458f3b6f686 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.740343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 419/826] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:40.741871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3b4b-8f23-476f-bd0d-788311b26f0f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.742161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3b4b-8f23-476f-bd0d-788311b26f0f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.746572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a3b4b-8f23-476f-bd0d-788311b26f0f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.748666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 420/827] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:40.750267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a3b4b-8f23-476f-bd0d-788311b26f0f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.779129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbe6a5-1ea6-4f0f-8e06-7bd3ec50ce65 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.827942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363e85e-eb1f-4c08-a7e0-eb36f1d7a047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.827942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e85e-eb1f-4c08-a7e0-eb36f1d7a047 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.828227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e85e-eb1f-4c08-a7e0-eb36f1d7a047 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.828478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363e85e-eb1f-4c08-a7e0-eb36f1d7a047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.837359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363e85e-eb1f-4c08-a7e0-eb36f1d7a047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.838910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363e85e-eb1f-4c08-a7e0-eb36f1d7a047 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0363e85e-eb1f-4c08-a7e0-eb36f1d7a047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:40.854106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:40.855107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:40.856594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 408/828] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:40.857095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8b74-5b62-45d5-a37c-71b5e47ec2df None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.857162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8b74-5b62-45d5-a37c-71b5e47ec2df None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.857405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d8b74-5b62-45d5-a37c-71b5e47ec2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.874247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1a9d8b74-5b62-45d5-a37c-71b5e47ec2df None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:40.875452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1a9d8b74-5b62-45d5-a37c-71b5e47ec2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:40.877126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.884165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:40.885596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a3b4b-8f23-476f-bd0d-788311b26f0f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:40.923905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:40.924831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:40.925104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:40.925373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:40.932563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:40.933946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:40.948162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:40.949097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:40.950537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:40.954402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 421/829] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:40.955311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:40.958589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 409/830] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:40.959369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d8b74-5b62-45d5-a37c-71b5e47ec2df None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.064897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fab4a-7581-4cba-82d7-b4ad29fcba95 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.071964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d8b74-5b62-45d5-a37c-71b5e47ec2df None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.099693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.100285 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.100563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.100833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.101614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:41.101917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.103387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.108782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.109614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.110142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.110582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.111502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:41.112028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.113590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.114781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 422/831] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:41.116137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.133475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 410/832] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:41.134628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.137579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.142714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.226930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac92546-376b-4432-8a08-2e67fbf91dde None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.249365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d752c3-98c0-4e73-9e56-aa7ea94338fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.265869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.266878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.267258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.267609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.278072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:41.284132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614551b-8eee-4b60-9cb4-c5f579834f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.284802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614551b-8eee-4b60-9cb4-c5f579834f0f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.285087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614551b-8eee-4b60-9cb4-c5f579834f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.285363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614551b-8eee-4b60-9cb4-c5f579834f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:41.286074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:41.287156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:14:41.293055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:41.293841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614551b-8eee-4b60-9cb4-c5f579834f0f None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5253b3eec6ae45f3bca9369107c4d93a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:41.293841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614551b-8eee-4b60-9cb4-c5f579834f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.294009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 423/833] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:41.294088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614551b-8eee-4b60-9cb4-c5f579834f0f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.294167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.298740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 411/834] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/role_assignments?user.id=5253b3eec6ae45f3bca9369107c4d93a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:41.300076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb7493-822b-4583-b663-aedc0d719baf None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.300417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb7493-822b-4583-b663-aedc0d719baf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.300771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb7493-822b-4583-b663-aedc0d719baf None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.302174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 412/835] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:41.307048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb7493-822b-4583-b663-aedc0d719baf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.379261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.391249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.407700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f01f-2ef7-4cf4-b9f6-20b7b3b1e2fc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.432228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb7493-822b-4583-b663-aedc0d719baf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.447229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e895e-698f-4cca-9243-310af9cd79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.448243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e895e-698f-4cca-9243-310af9cd79d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.448527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e895e-698f-4cca-9243-310af9cd79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.448938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e895e-698f-4cca-9243-310af9cd79d6 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/c2841ffed5bb4257b20a5e88271d6979/roles/b18a579464c34ea6b4fb3ea7940aa4f6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.469387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e895e-698f-4cca-9243-310af9cd79d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=c2841ffed5bb4257b20a5e88271d6979, role_id=b18a579464c34ea6b4fb3ea7940aa4f6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.470147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e895e-698f-4cca-9243-310af9cd79d6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.476964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.477733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.478016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.478318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.479139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:41.479442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.480811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.485350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 424/836] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:41 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/c2841ffed5bb4257b20a5e88271d6979/roles/b18a579464c34ea6b4fb3ea7940aa4f6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:41.486665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d87b9-a86d-456f-a6b5-de86b558eedf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.486958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d87b9-a86d-456f-a6b5-de86b558eedf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.487234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d87b9-a86d-456f-a6b5-de86b558eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.490358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 413/837] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:41.498265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.505927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-639d87b9-a86d-456f-a6b5-de86b558eedf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:41.507996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-639d87b9-a86d-456f-a6b5-de86b558eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:41.604574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 425/838] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:41.628742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d87b9-a86d-456f-a6b5-de86b558eedf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.637387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f9b40-4e34-494a-8857-56013bc143cd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.673961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.688712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.689689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.690071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.690477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.695547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.704672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.706397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:41.731024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:41.732200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:41.733480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:41.733480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:41.733480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:41.733480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:41.736226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 414/839] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:41.742881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.750743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d87b9-a86d-456f-a6b5-de86b558eedf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.793889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.794885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.795350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.795724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.796999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.798946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:41.814627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:41.815924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:41.816970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:41.819372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 426/840] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:41.827479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.882322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57ceaa-0b49-4c14-b121-9ac055f46a72 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.919574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.920206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.920482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.920752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.921473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:41.922010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.923196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:41.935983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 415/841] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:41.941322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:41.949255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9ed5c-f7b9-4c75-bd77-3e00ed7d8929 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:41.976092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.990795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:41.994227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:41.995194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:41.995633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:41.996061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:41.996952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:41.998473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:41.999350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:42.005629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 427/842] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:42.011258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:42.050317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae9700-99de-4e9b-a4e2-90fde7243e0c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:42.084635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:42.085454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:42.085729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:42.085997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:42.093663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:42.095163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:42.110000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:42.111171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:42.112276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 416/843] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:14:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:42.119763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:42.121504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a945ac-9d2f-4089-acdc-bf07ebf53825 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:42.158557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:42.159256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:42.159538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:42.159811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:42.160520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:42.160936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:42.166321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:42.174724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 428/844] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:42.235843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:42.238901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422df8a-1c29-42fb-97ea-efdcdef34d00 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:42.278306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:42.279006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:42.279285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:42.280053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:42.280908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:42.281215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:42.282700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:42.303456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 417/845] 10.222.0.50 () {56 vars in 1135 bytes} [Tue Jul 12 17:14:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:42.308950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:42.372877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:42.425280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668c6a-4241-4c65-bf87-433afa45e58b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:42.458909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:42.459568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:42.459842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:42.460115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:42.531960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:42.533415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:42.583081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:42.635652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 429/846] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:14:42.641195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:42.752220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699697-2db4-40eb-9d5d-468447143ef2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:42.786828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:42.787674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:42.787953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:42.788228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:42.798568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:42.800009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:42.817670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:42.818619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:42.819512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:42.819512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:42.819512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:42.819512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:42.819512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 418/847] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:42.827603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:42.926476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0931-208b-4a32-b2c5-f727a67d002f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:42.961162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:42.961832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:42.962107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:42.962411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:42.963130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:42.963429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:42.964860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:42.976752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 430/848] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:42.983737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:42.998800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:43.094835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ba76d-b8c9-499d-b8cb-7638182e5416 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:43.130004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:43.130847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.131120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.131386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.138626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:43.140154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:43.154797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:43.157137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:43.158916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 419/849] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:43.164658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:43.176320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:43.268398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23024624-14a5-407c-a35e-54abbd7af2e9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:43.304711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173f37-9a5c-4e69-aa86-1fdcc3ec1ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:43.305383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173f37-9a5c-4e69-aa86-1fdcc3ec1ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.305661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173f37-9a5c-4e69-aa86-1fdcc3ec1ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.305933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173f37-9a5c-4e69-aa86-1fdcc3ec1ea1 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.306753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e173f37-9a5c-4e69-aa86-1fdcc3ec1ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:43.307060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e173f37-9a5c-4e69-aa86-1fdcc3ec1ea1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:43.308489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e173f37-9a5c-4e69-aa86-1fdcc3ec1ea1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:43.321803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 431/850] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:43.328002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:43.403842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:43.440554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2103ac-17a4-42b7-86fb-e5cb1eda3ac7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:43.476154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a864e-baa9-4c86-828b-37f5f0149223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:43.476834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a864e-baa9-4c86-828b-37f5f0149223 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.477115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a864e-baa9-4c86-828b-37f5f0149223 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.477388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a864e-baa9-4c86-828b-37f5f0149223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.478230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a864e-baa9-4c86-828b-37f5f0149223 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5731c3ee4a284ae085eedd600c21bc39) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:43.478578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a864e-baa9-4c86-828b-37f5f0149223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:43.480043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a864e-baa9-4c86-828b-37f5f0149223 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:43.487280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 420/851] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:43 2022] GET /identity/v3/role_assignments?user.id=5731c3ee4a284ae085eedd600c21bc39&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:43.502871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c648-470e-4725-ba63-babca8d748b9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.503152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c648-470e-4725-ba63-babca8d748b9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.503423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4c648-470e-4725-ba63-babca8d748b9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.506320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 432/852] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:43.511279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5904c-4886-4f6b-bc8c-e15f6e111ded None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.511569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5904c-4886-4f6b-bc8c-e15f6e111ded None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.511858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5904c-4886-4f6b-bc8c-e15f6e111ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.531071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-55f5904c-4886-4f6b-bc8c-e15f6e111ded None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:43.532296 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-55f5904c-4886-4f6b-bc8c-e15f6e111ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:43.618137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 421/853] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:43.640694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c648-470e-4725-ba63-babca8d748b9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:43.705985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8dc9-08ca-492d-9788-6d4ed1417143 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.706335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8dc9-08ca-492d-9788-6d4ed1417143 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.706496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d8dc9-08ca-492d-9788-6d4ed1417143 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.708090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 422/854] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:43.714147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d53a5-e091-4ce6-869a-78e7d9aa4f52 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.714477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d53a5-e091-4ce6-869a-78e7d9aa4f52 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.714753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d53a5-e091-4ce6-869a-78e7d9aa4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.721487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:43.738767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9a7d53a5-e091-4ce6-869a-78e7d9aa4f52 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:43.739947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9a7d53a5-e091-4ce6-869a-78e7d9aa4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:43.761324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4c648-470e-4725-ba63-babca8d748b9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:43.797754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:43.798651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.798981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.799256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.799962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:43.801352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:43.817952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:43.819003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:43.820297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 433/855] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Jul 12 17:14:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:43.822915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:43.825707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:43.834977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 423/856] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:43.860070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d53a5-e091-4ce6-869a-78e7d9aa4f52 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:43.930111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6aa1e-dae5-4915-b3d5-5ea41c44a4c6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:43.960212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:43.965945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:43.966671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:43.967461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:43.967715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:43.968638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:43.969473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:43.970926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:43.977339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d53a5-e091-4ce6-869a-78e7d9aa4f52 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:43.980938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 434/857] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:43.982005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:44.018091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:44.019571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.020003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.020423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.032376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:44.041057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:44.042214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:14:44.043260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:44.050278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 424/858] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:14:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:44.055319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:44.087944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a38c38-57f3-4e4f-a071-49c648f7cdc7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:44.124620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:44.125462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.125812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.126150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.126968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:44.127338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:44.128782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:44.134724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:44.142963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 435/859] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:44.191436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ec058-eeeb-4548-b5d8-4eac030341eb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:44.231763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3844d-eca4-4048-b034-ef5a48da3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:44.232815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3844d-eca4-4048-b034-ef5a48da3e4d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.233277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3844d-eca4-4048-b034-ef5a48da3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.233724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3844d-eca4-4048-b034-ef5a48da3e4d None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.234710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3844d-eca4-4048-b034-ef5a48da3e4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:44.235236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3844d-eca4-4048-b034-ef5a48da3e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:44.236833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3844d-eca4-4048-b034-ef5a48da3e4d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:44.251844 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 425/860] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:14:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:44.253572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:44.295756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6e34-1db9-4ed4-a1c7-db3ddb830572 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.296098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6e34-1db9-4ed4-a1c7-db3ddb830572 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.296408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6e34-1db9-4ed4-a1c7-db3ddb830572 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.297802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 426/861] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:44.303668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f367-4092-4561-88dc-54492aaa4ca2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.303950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f367-4092-4561-88dc-54492aaa4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.304223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36f367-4092-4561-88dc-54492aaa4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.327698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6a36f367-4092-4561-88dc-54492aaa4ca2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:44.329118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6a36f367-4092-4561-88dc-54492aaa4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:44.333904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:44.390909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5f222-ef03-4fcc-8405-78b05a9c3824 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:44.403988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 427/862] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:44.426110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f367-4092-4561-88dc-54492aaa4ca2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:44.434233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:44.435829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.436261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.436753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.453788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:44.456143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:44.478330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:44.479281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:44.480206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:44.480206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:44.480206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:44.480206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:44.482111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 436/863] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:44.486954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:44.488014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:44.541934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36f367-4092-4561-88dc-54492aaa4ca2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:44.578378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:44.582052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.582360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.582636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.583395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:44.584856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:44.600470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c7467-d843-493c-9f2d-fd5b93818387 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:44.613411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 428/864] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:14:44 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:44.623860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:44.646961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:44.647827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.648109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.648384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.649133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:44.649442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:44.651082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:44.670481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 437/865] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:44.672144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:44.794786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2dd0b9-e847-45a2-ae7b-3230e3d56eec None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:44.802846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:44.834241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:44.835123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:44.835406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:44.835680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:44.843595 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:44.845135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:44.861347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:44.862382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:44.863345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:44.866409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 429/866] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:14:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:44.869137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:44.970529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dcd8c-6e0c-4166-8235-40d4ba532abb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:45.004450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:45.005130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.005410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.005736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.006652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:45.006968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:45.008405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:45.030400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 438/867] 10.222.0.50 () {56 vars in 1149 bytes} [Tue Jul 12 17:14:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:45.032089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:45.138624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fc521-c0bf-47ec-a65b-79400d7c397e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:45.175268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:45.176329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.176827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.177299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.212739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:45.250182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:45.252121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:45.356328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 430/868] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:45 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:14:45.361892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:45.394927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:45.471339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b92442-da69-413e-917c-db97b8e342ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:45.506111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96cec3-572a-4d6f-b386-b2a28095ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:45.506942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96cec3-572a-4d6f-b386-b2a28095ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.507223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96cec3-572a-4d6f-b386-b2a28095ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.507493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96cec3-572a-4d6f-b386-b2a28095ccd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.517770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96cec3-572a-4d6f-b386-b2a28095ccd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:45.519259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96cec3-572a-4d6f-b386-b2a28095ccd7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9e96cec3-572a-4d6f-b386-b2a28095ccd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:45.536554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:45.537452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:45.538371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:45.538371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:45.538371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:45.538371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:45.538371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 439/869] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:45.543550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:45.617237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443219c-0034-43cf-a057-7a789f2b1894 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.617541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443219c-0034-43cf-a057-7a789f2b1894 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.617895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443219c-0034-43cf-a057-7a789f2b1894 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.622982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 440/870] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:45.624126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f37d-f153-4101-89c5-124def2087f1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.624413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f37d-f153-4101-89c5-124def2087f1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.624689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7f37d-f153-4101-89c5-124def2087f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.626873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:45.642302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d2c7f37d-f153-4101-89c5-124def2087f1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:45.643530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d2c7f37d-f153-4101-89c5-124def2087f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:45.664564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614252c6-34ab-4212-af6b-943ac4dae137 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:45.702604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:45.703872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.704334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.704961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.706168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:45.706686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:45.708677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:45.729062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 431/871] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:45.729942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 441/872] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:45.730912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:45.751310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7f37d-f153-4101-89c5-124def2087f1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:45.762660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:45.852492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f223c6f-ef42-41d4-83ce-d210282fff83 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:45.882010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:45.887861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7f37d-f153-4101-89c5-124def2087f1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:45.894614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:45.895737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.896221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.896737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.904506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:45.906234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:45.921103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:45.922022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:45.923094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:45.929608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:45.929608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:45.929608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:45.929608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:45.930109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:45.930253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 432/873] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:45.931622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:45.931989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:45.946948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:45.948114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:45.949336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 442/874] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:45.954584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:46.043538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14577f46-85b0-4086-a084-8095ba3f2c3b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:46.050742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:46.090509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:46.091523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.092035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.092533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.092795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db417685-d0cd-4a55-910a-3639d537393a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:46.093726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:46.094278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:46.096006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:46.114236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 433/875] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:46.116284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:46.135100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:46.136017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.136310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.136584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.137326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:46.137994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:46.139795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:46.146794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 443/876] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:46.152648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:46.169486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:46.228318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14df0-8f4c-4a95-acb0-7a01724bb2e3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:46.277461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fae2c-9884-4c8d-ad06-78d02f7a1101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:46.279057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fae2c-9884-4c8d-ad06-78d02f7a1101 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.279653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fae2c-9884-4c8d-ad06-78d02f7a1101 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.280315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fae2c-9884-4c8d-ad06-78d02f7a1101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.280713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc5cfa-9e5a-40ba-9288-d204e264e4e5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:46.281606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fae2c-9884-4c8d-ad06-78d02f7a1101 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=c2841ffed5bb4257b20a5e88271d6979) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:46.282267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fae2c-9884-4c8d-ad06-78d02f7a1101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:46.284763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fae2c-9884-4c8d-ad06-78d02f7a1101 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:46.292750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 434/877] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:46 2022] GET /identity/v3/role_assignments?user.id=c2841ffed5bb4257b20a5e88271d6979&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:46.294796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efffcd5-dbb5-4ec6-afca-4587fe226f5d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.296062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efffcd5-dbb5-4ec6-afca-4587fe226f5d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.296560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efffcd5-dbb5-4ec6-afca-4587fe226f5d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.299012 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 435/878] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:46.304163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012cf3e-38b5-42fa-9719-ca874dfdca04 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.304458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012cf3e-38b5-42fa-9719-ca874dfdca04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.304733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012cf3e-38b5-42fa-9719-ca874dfdca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.323346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:46.324044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f012cf3e-38b5-42fa-9719-ca874dfdca04 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:46.324792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.325241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.325346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f012cf3e-38b5-42fa-9719-ca874dfdca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:46.325807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.327020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:46.327832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:46.329491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:46.332592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:46.337077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 444/879] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:46.409051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 436/880] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:46.432757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:46.549264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f4f62-e510-4f8d-9a97-756f926f39e4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:46.597517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbff0d2-0ca5-4c74-bc25-bce9a53c3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:46.598847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbff0d2-0ca5-4c74-bc25-bce9a53c3900 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.599352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbff0d2-0ca5-4c74-bc25-bce9a53c3900 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.599821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbff0d2-0ca5-4c74-bc25-bce9a53c3900 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.600750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbff0d2-0ca5-4c74-bc25-bce9a53c3900 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:46.602514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbff0d2-0ca5-4c74-bc25-bce9a53c3900 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:46.624069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 445/881] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:14:46 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:46.830513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472db5-9dfd-4156-ac6a-8475394ce052 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.830927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472db5-9dfd-4156-ac6a-8475394ce052 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.831103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd472db5-9dfd-4156-ac6a-8475394ce052 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.832620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 437/882] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:46.837912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c99c1-3e68-49ea-a5ee-ee09762dbd3a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:46.838485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c99c1-3e68-49ea-a5ee-ee09762dbd3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:46.838950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c99c1-3e68-49ea-a5ee-ee09762dbd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:46.856470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a43c99c1-3e68-49ea-a5ee-ee09762dbd3a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:46.858272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a43c99c1-3e68-49ea-a5ee-ee09762dbd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:46.924013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:46.954155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 446/883] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:46.977434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd472db5-9dfd-4156-ac6a-8475394ce052 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:47.025493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:47.087128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd472db5-9dfd-4156-ac6a-8475394ce052 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:47.122147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:47.123001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:47.123319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:47.123590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:47.124243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:47.125636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:47.137719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:47.138802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:47.139803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 438/884] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:47.147508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c99c1-3e68-49ea-a5ee-ee09762dbd3a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:47.255206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c99c1-3e68-49ea-a5ee-ee09762dbd3a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:47.289483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:47.290155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:47.290472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:47.290746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:47.291453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:47.291758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:47.293133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:47.298281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 447/885] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:47.307462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:47.409551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555917f-32ce-45df-a8b1-69be9d9b7a99 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:47.412366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:47.446613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:47.447285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:47.447572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:47.447833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:47.448535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:47.448833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:47.450210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:47.455548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 439/886] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:47.461325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:47.513628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:47.570570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63e3b7-8839-4d23-8df6-c5bceaa3be31 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:47.607052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3adb6a-a0ed-438d-8e5d-2471fa317f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:47.607980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3adb6a-a0ed-438d-8e5d-2471fa317f0a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:47.608791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3adb6a-a0ed-438d-8e5d-2471fa317f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:47.609069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3adb6a-a0ed-438d-8e5d-2471fa317f0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:47.609877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3adb6a-a0ed-438d-8e5d-2471fa317f0a None admin] RBAC: Adding query filter params (interface=public, service_id=cf80578272c044288a53f169920f1a90, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:47.610192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3adb6a-a0ed-438d-8e5d-2471fa317f0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:47.611604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3adb6a-a0ed-438d-8e5d-2471fa317f0a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:47.619166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 448/887] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:14:47 2022] GET /identity/v3/endpoints?service_id=cf80578272c044288a53f169920f1a90&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:47.624682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:47.726259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713bd2d-0b5d-4a12-86db-83b5216d3d85 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:47.759890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27600f94-d9ad-45ed-8253-4e7ec27a16f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:47.760611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27600f94-d9ad-45ed-8253-4e7ec27a16f3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:47.760880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27600f94-d9ad-45ed-8253-4e7ec27a16f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:47.761200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27600f94-d9ad-45ed-8253-4e7ec27a16f3 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:47.761885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27600f94-d9ad-45ed-8253-4e7ec27a16f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:47.763282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27600f94-d9ad-45ed-8253-4e7ec27a16f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:47.769539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 440/888] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:14:47 2022] GET /identity/v3/services => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:14:48.528624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc641-f1e5-44be-b964-6b40b12910a8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.529189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc641-f1e5-44be-b964-6b40b12910a8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.529189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc641-f1e5-44be-b964-6b40b12910a8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.531546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 449/889] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:48.536960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c992d-663b-4f0f-bc45-fd3f6a815282 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.537396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c992d-663b-4f0f-bc45-fd3f6a815282 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.537594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c992d-663b-4f0f-bc45-fd3f6a815282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.555475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-859c992d-663b-4f0f-bc45-fd3f6a815282 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:48.556674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-859c992d-663b-4f0f-bc45-fd3f6a815282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:48.572082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d630-87e2-4e87-8873-3ac18ae7576a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.572369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d630-87e2-4e87-8873-3ac18ae7576a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.572646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d630-87e2-4e87-8873-3ac18ae7576a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.574249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 450/890] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:48.579451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7e84-aeb9-4b1c-8d84-7a4ffe9313f9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.579736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7e84-aeb9-4b1c-8d84-7a4ffe9313f9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.580016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7e84-aeb9-4b1c-8d84-7a4ffe9313f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.587420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:48.598463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-051f7e84-aeb9-4b1c-8d84-7a4ffe9313f9 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:48.600061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-051f7e84-aeb9-4b1c-8d84-7a4ffe9313f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:48.639138 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 441/891] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:48.664010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c992d-663b-4f0f-bc45-fd3f6a815282 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:48.688395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 451/892] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:48.712817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7e84-aeb9-4b1c-8d84-7a4ffe9313f9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:48.770813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:48.792620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c992d-663b-4f0f-bc45-fd3f6a815282 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:48.830322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256df71-013d-43ea-a5bb-1160e840326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:48.830994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256df71-013d-43ea-a5bb-1160e840326c None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.831279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256df71-013d-43ea-a5bb-1160e840326c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.831549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256df71-013d-43ea-a5bb-1160e840326c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.832280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256df71-013d-43ea-a5bb-1160e840326c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:48.833660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256df71-013d-43ea-a5bb-1160e840326c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:48.837949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7e84-aeb9-4b1c-8d84-7a4ffe9313f9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:48.855656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 442/893] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:14:48 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:14:48.855656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881922b-de12-42a5-ae63-b5cc5bc6c40c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.855656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881922b-de12-42a5-ae63-b5cc5bc6c40c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.855656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881922b-de12-42a5-ae63-b5cc5bc6c40c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.855656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 443/894] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:48.862604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f13262-5a85-479e-b592-d94685c22fe1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.862934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f13262-5a85-479e-b592-d94685c22fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.863166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f13262-5a85-479e-b592-d94685c22fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.885978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-31f13262-5a85-479e-b592-d94685c22fe1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:48.887577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-31f13262-5a85-479e-b592-d94685c22fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:48.889449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:48.890364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:48.890652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:48.890931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:48.902915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:48.911126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:48.911583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:48.912730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:14:48.913727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:48.918152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 452/895] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Jul 12 17:14:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:48.919177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.010864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 444/896] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:49.030964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f13262-5a85-479e-b592-d94685c22fe1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.037136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:49.039231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593af6da-ca56-4730-b6d8-a4f9c44dc3d4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.081380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.082434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.082904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.083371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.084140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:49.084449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.085855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.095968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 453/897] 10.222.0.50 () {56 vars in 1115 bytes} [Tue Jul 12 17:14:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:49.105625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.171700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f13262-5a85-479e-b592-d94685c22fe1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.219229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.220786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.221216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.221865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.222725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.224265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:49.240936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:49.241957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:49.242860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:49.245698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 445/898] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:49.258577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.270934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5a53-03a2-4631-98db-574e47ffa635 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.280003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:49.311993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.313169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.313668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.314167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.325939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.328040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:49.346486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:49.347427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:49.348303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:49.348303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:49.348303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:49.348303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:49.350637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 454/899] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:49.356382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.376243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609af9a4-1c39-448b-a8ae-dc97728d693d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.379444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:49.428887 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.429569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.429850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.430142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.430873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:49.431182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.432756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.438700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 446/900] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:49.443865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.488610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e7ac2-8348-4f79-a5d5-013487c5ca23 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.539445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.540733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:49.542502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.542926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.543337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.544437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:49.545252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.547261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.564327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca070c-9add-4dbf-8e44-6b4c38196bbb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.566437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 455/901] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:49.570265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.609029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.609730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.609993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.610263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.611089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:49.611321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.612702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.623187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 447/902] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:49.624235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.674311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:49.701698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60779128-f9bc-48b9-a8d8-057b81bc9fd3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.738148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.739028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.739308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.739578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.747477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.748990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.756670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab0ab1-2611-4f51-af91-91bd42a62174 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:49.764646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:49.765600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:49.766582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:49.770654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 456/903] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:49.771574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.799612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dada7-d552-4050-9d96-a56a51d7be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.800284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dada7-d552-4050-9d96-a56a51d7be98 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.800569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dada7-d552-4050-9d96-a56a51d7be98 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.800845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dada7-d552-4050-9d96-a56a51d7be98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.801645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dada7-d552-4050-9d96-a56a51d7be98 None admin] RBAC: Adding query filter params (interface=public, service_id=4b1e55eeebab4924a0b2983007c0e0cf, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:49.801962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dada7-d552-4050-9d96-a56a51d7be98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.803393 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dada7-d552-4050-9d96-a56a51d7be98 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.808803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 448/904] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/endpoints?service_id=4b1e55eeebab4924a0b2983007c0e0cf&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:49.809966 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2eb4e-d65b-4365-9083-836061c1e06b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.810251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2eb4e-d65b-4365-9083-836061c1e06b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.810583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2eb4e-d65b-4365-9083-836061c1e06b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.812255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 449/905] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:49.815124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2eb4e-d65b-4365-9083-836061c1e06b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:49.829639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:49.880397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70453dd2-ef52-454f-bbf4-c057b8cc37ac None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.916750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1541a-b54b-4a64-b3b4-c8cef7ecd7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.917574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1541a-b54b-4a64-b3b4-c8cef7ecd7af None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.917855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1541a-b54b-4a64-b3b4-c8cef7ecd7af None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.918127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1541a-b54b-4a64-b3b4-c8cef7ecd7af None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.919019 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1541a-b54b-4a64-b3b4-c8cef7ecd7af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:49.919308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1541a-b54b-4a64-b3b4-c8cef7ecd7af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.920838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1541a-b54b-4a64-b3b4-c8cef7ecd7af None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.922933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:49.929448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2eb4e-d65b-4365-9083-836061c1e06b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:49.945836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 457/906] 10.222.0.50 () {56 vars in 1149 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:49.945836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ef27-72ad-4f25-b069-64c00450b215 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.945836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ef27-72ad-4f25-b069-64c00450b215 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.945836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ef27-72ad-4f25-b069-64c00450b215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.958554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2757ef27-72ad-4f25-b069-64c00450b215 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:49.959749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2757ef27-72ad-4f25-b069-64c00450b215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:49.975214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:49.975861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:49.976139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:49.976407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:49.977086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:49.978490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:49.984981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 450/907] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:14:49.985784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.050083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 458/908] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:50.075161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ef27-72ad-4f25-b069-64c00450b215 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.083828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:50.127677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8008c-0b85-4c1c-beac-cbcf01763c67 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:50.179105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:50.179693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:50.179972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:50.180245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:50.196496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ef27-72ad-4f25-b069-64c00450b215 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:50.225247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:50.242690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:50.243866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:50.244356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:50.244828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:50.245686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:50.247310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:50.260658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:50.261743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 17:14:50.262691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:50.265793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 459/909] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:50.270184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:50.271900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:50.275705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.360857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:50.405448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 451/910] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:14:50.411009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.419177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fcca0-5d01-4116-b266-8af7e4bff82b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:50.467138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:50.469089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:50.469741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:50.470681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:50.471736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:50.472056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:50.473848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:50.480952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 460/911] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:50.486521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.531403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29b171-40f7-4299-b491-1061fab5bcf6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:50.553778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:50.573018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:50.573926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:50.574278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:50.574669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:50.587291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:50.588859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:50.610811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:50.612067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:50.613018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:50.613018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:50.613018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:50.613018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:50.618876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 452/912] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:50.621669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.622756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d63a8-c182-49fc-b891-9eec95c2bb67 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:50.649642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:50.661465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:50.662251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:50.662658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:50.663024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:50.663887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:50.664258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:50.666019 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:50.672147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 461/913] 10.222.0.50 () {56 vars in 1114 bytes} [Tue Jul 12 17:14:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:50.682003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.758830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adac4f8-211d-4f37-802e-2319d790dc2e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:50.804281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:50.805254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:50.805782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:50.806066 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:50.806834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:50.807146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:50.809025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:50.815818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec919f-87bb-427a-8e24-d97fbd3f4484 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:50.828185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 453/914] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:50.831254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:50.835361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:50.856824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930d0e-1b7e-4396-83ec-0723450ef555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:50.857560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930d0e-1b7e-4396-83ec-0723450ef555 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:50.858431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930d0e-1b7e-4396-83ec-0723450ef555 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:50.858719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930d0e-1b7e-4396-83ec-0723450ef555 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:50.859467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930d0e-1b7e-4396-83ec-0723450ef555 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:50.860840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930d0e-1b7e-4396-83ec-0723450ef555 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:50.890343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 462/915] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:14:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:50.941220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:50.963359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736f606-08b4-437a-ade9-2fd1e3436679 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:51.011109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a6d31-c512-4e34-9990-61e2a72ddd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:51.011921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a6d31-c512-4e34-9990-61e2a72ddd27 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.012204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a6d31-c512-4e34-9990-61e2a72ddd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.012476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a6d31-c512-4e34-9990-61e2a72ddd27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.021410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a6d31-c512-4e34-9990-61e2a72ddd27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:51.022941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a6d31-c512-4e34-9990-61e2a72ddd27 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-d71a6d31-c512-4e34-9990-61e2a72ddd27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:51.040522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:51.041506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:51.042485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:51.042950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7fe4-b080-43f3-b48b-ee3ac758f8a9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.042950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7fe4-b080-43f3-b48b-ee3ac758f8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.043085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 454/916] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:51.043153 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d7fe4-b080-43f3-b48b-ee3ac758f8a9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.044188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 463/917] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:14:51.049704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711f6bc-b796-4cff-a45c-4032c67bfbea None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.049996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711f6bc-b796-4cff-a45c-4032c67bfbea None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.050199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7fe4-b080-43f3-b48b-ee3ac758f8a9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:51.050376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711f6bc-b796-4cff-a45c-4032c67bfbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.069640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5711f6bc-b796-4cff-a45c-4032c67bfbea None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:51.071035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5711f6bc-b796-4cff-a45c-4032c67bfbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:51.163824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 455/918] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:51.188852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711f6bc-b796-4cff-a45c-4032c67bfbea None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:51.191132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d7fe4-b080-43f3-b48b-ee3ac758f8a9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:51.234757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:51.235836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.236330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.236804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.237796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:51.238343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:51.240835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:51.257865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 464/919] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:51.263704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:51.274926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:51.298713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:51.307443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711f6bc-b796-4cff-a45c-4032c67bfbea None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:51.344797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:51.345621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.345897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.346182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.347078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:51.348263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:51.361004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:51.362062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:51.363244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:51.367592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 456/920] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:51.368862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:51.385027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a2ab4-69b5-4734-813f-0f8017b2c93e None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:51.425215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:51.426392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.426870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.427354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.428513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] RBAC: Adding query filter params (role.id=b76995da93e340c78515bc83dde12343, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=c2841ffed5bb4257b20a5e88271d6979) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:51.429096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:51.430860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:51.446534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 465/921] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:14:51 2022] GET /identity/v3/role_assignments?user.id=c2841ffed5bb4257b20a5e88271d6979&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b76995da93e340c78515bc83dde12343 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:51.474252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b040e5-d73b-4def-bdf0-13b65747cb53 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:51.513386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:51.514209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.514481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.514960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.515701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:51.516007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:51.517439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:51.518806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:51.523447 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 457/922] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:51.529955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:51.647378 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:51.654785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd92f1e-4353-4d37-8cc9-e1f3dcda0901 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:51.691590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:51.692561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.692997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.693421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.694426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:51.694896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:51.696421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:51.706401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 466/923] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:51.708962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:51.825093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabef54-2911-4b14-879e-0de01c10666d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:51.861629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e29de-eabf-4dd6-8d44-100aea3fe873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:51.862313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e29de-eabf-4dd6-8d44-100aea3fe873 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:51.862611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e29de-eabf-4dd6-8d44-100aea3fe873 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:51.862892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e29de-eabf-4dd6-8d44-100aea3fe873 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:51.863687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e29de-eabf-4dd6-8d44-100aea3fe873 None admin] RBAC: Adding query filter params (interface=public, service_id=8c2669b4eccf4b06a3491f8a7d425fe7, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:51.864003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e29de-eabf-4dd6-8d44-100aea3fe873 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:51.865738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e29de-eabf-4dd6-8d44-100aea3fe873 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:51.876416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 458/924] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:14:51 2022] GET /identity/v3/endpoints?service_id=8c2669b4eccf4b06a3491f8a7d425fe7&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:51.877798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:51.983018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0952d-0531-4aef-992a-af55c6f3dd1c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:52.018964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae9cc0-af20-4d98-8e3a-613f5564d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:52.019643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9cc0-af20-4d98-8e3a-613f5564d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:52.019929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9cc0-af20-4d98-8e3a-613f5564d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:52.020203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9cc0-af20-4d98-8e3a-613f5564d3e1 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:52.020890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae9cc0-af20-4d98-8e3a-613f5564d3e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:52.022266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae9cc0-af20-4d98-8e3a-613f5564d3e1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:52.029017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 467/925] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:14:51 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:14:52.141804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32fa0-1490-4a2c-9bd5-9ecb02ab1fa4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:52.142522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32fa0-1490-4a2c-9bd5-9ecb02ab1fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:52.143030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d32fa0-1490-4a2c-9bd5-9ecb02ab1fa4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:52.144944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 459/926] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:52.150968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618b1b-b80c-427c-b4ae-1dcbce212e5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:52.151581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618b1b-b80c-427c-b4ae-1dcbce212e5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:52.152050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618b1b-b80c-427c-b4ae-1dcbce212e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:52.170708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d1618b1b-b80c-427c-b4ae-1dcbce212e5f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:52.172513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d1618b1b-b80c-427c-b4ae-1dcbce212e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:52.192772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:52.246930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 468/927] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:52.269696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d32fa0-1490-4a2c-9bd5-9ecb02ab1fa4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:52.335014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:52.388713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d32fa0-1490-4a2c-9bd5-9ecb02ab1fa4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:52.425138 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:52.425931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:52.426213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:52.426513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:52.427170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:52.428544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:52.441498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:52.442516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:52.443868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 460/928] 10.222.0.50 () {56 vars in 1132 bytes} [Tue Jul 12 17:14:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:52.449132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618b1b-b80c-427c-b4ae-1dcbce212e5f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:52.550418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618b1b-b80c-427c-b4ae-1dcbce212e5f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:52.591407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:52.592606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:52.593094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:52.593585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:52.594564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:52.595115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:52.596779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:52.603339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 469/929] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:52.609472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:52.717268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480f768-92c0-4043-89b5-eb46c8bfdacf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:52.744352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:52.754243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181fc04-a7d1-4d9a-b8b6-2736ce51719f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:52.755229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181fc04-a7d1-4d9a-b8b6-2736ce51719f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:52.755727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181fc04-a7d1-4d9a-b8b6-2736ce51719f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:52.756198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181fc04-a7d1-4d9a-b8b6-2736ce51719f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:52.757117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181fc04-a7d1-4d9a-b8b6-2736ce51719f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:52.757618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181fc04-a7d1-4d9a-b8b6-2736ce51719f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:52.759218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181fc04-a7d1-4d9a-b8b6-2736ce51719f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:52.765298 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 461/930] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:52.771257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:52.790410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:52.878472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91233b-7bd0-49a3-b8f5-9e11d4461068 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:52.914332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de8a04-4de0-47b1-bbda-8fae47813f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:52.915490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8a04-4de0-47b1-bbda-8fae47813f11 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:52.915990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8a04-4de0-47b1-bbda-8fae47813f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:52.916458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de8a04-4de0-47b1-bbda-8fae47813f11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:52.917424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8a04-4de0-47b1-bbda-8fae47813f11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:52.919024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de8a04-4de0-47b1-bbda-8fae47813f11 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:52.941242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 470/931] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:14:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:53.094705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68448a0-d0fb-42ca-83f6-9e2ff9fe02f7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.095117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68448a0-d0fb-42ca-83f6-9e2ff9fe02f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.095240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68448a0-d0fb-42ca-83f6-9e2ff9fe02f7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.096855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 462/932] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:53.102667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ba243-9009-45ac-8921-30eb30cc2148 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.103377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ba243-9009-45ac-8921-30eb30cc2148 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.103846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ba243-9009-45ac-8921-30eb30cc2148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.122978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d90ba243-9009-45ac-8921-30eb30cc2148 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:53.124498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d90ba243-9009-45ac-8921-30eb30cc2148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:53.197130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:53.209924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 471/933] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:53.228314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68448a0-d0fb-42ca-83f6-9e2ff9fe02f7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:53.336406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68448a0-d0fb-42ca-83f6-9e2ff9fe02f7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:53.371623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:53.372311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.372593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.372864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.373696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:53.375177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:53.376559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING keystone.server.flask.common [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 17:14:53.395751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.sql.core [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 17:14:53.395751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 17:14:53.395751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [parameters: {'id': 'bc057c26421244d6bce0682c736b9a6a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 17:14:53.395751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80316) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0397276d-68c0-4c82-972a-45a22be02c9d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc057c26421244d6bce0682c736b9a6a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc057c26421244d6bce0682c736b9a6a. Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 17:14:53.403767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 17:14:53.404691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application yield resource Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application next(self.gen) Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise self.value Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application session.commit() Jul 12 17:14:53.406100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.session.flush() Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application compat.raise_( Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 17:14:53.407282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 17:14:53.408186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application conn.query(q) Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application result.read() Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 17:14:53.408976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [parameters: {'id': 'bc057c26421244d6bce0682c736b9a6a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:53.409934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:53.415185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc057c26421244d6bce0682c736b9a6a. Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.416336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 463/934] 10.222.0.50 () {60 vars in 1140 bytes} [Tue Jul 12 17:14:53 2022] POST /identity/v3/projects => generated 262 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:53.416968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ba243-9009-45ac-8921-30eb30cc2148 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:53.520327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ba243-9009-45ac-8921-30eb30cc2148 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:53.524221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0479d-7847-462e-830b-5e05999982b6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.524513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0479d-7847-462e-830b-5e05999982b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.524794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0479d-7847-462e-830b-5e05999982b6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.533297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 464/935] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:53.534664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea8fd-073e-4e33-ad4a-a6a38bda483f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.534801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea8fd-073e-4e33-ad4a-a6a38bda483f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.535085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addea8fd-073e-4e33-ad4a-a6a38bda483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.552703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-addea8fd-073e-4e33-ad4a-a6a38bda483f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:53.554230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-addea8fd-073e-4e33-ad4a-a6a38bda483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:53.565337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:53.566926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.567375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.567786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.577126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:53.579332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:53.596873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:53.597859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:53.598803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:53.600463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 472/936] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:53.600538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:53.606199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:53.634048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 465/937] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:53.656683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addea8fd-073e-4e33-ad4a-a6a38bda483f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:53.684538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:53.740883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8900c9-7ec9-4c1e-bb4e-6b84f6afcdd4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:53.768710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addea8fd-073e-4e33-ad4a-a6a38bda483f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:53.782013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:53.782834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.783184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.783826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.784459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:53.784830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:53.786534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:53.814345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 473/938] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:53.821418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:53.822384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:53.822670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:53.822944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:53.835871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:53.844646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:53.845675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:53.846610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 466/939] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Jul 12 17:14:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:53.852600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:53.967292 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b767866-4207-41fa-b6bb-aea733abb2ec None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:53.986991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:54.005746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.006823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.007318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.007799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.008583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:54.008885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.010251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.019070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 474/940] 10.222.0.50 () {56 vars in 1115 bytes} [Tue Jul 12 17:14:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:54.024837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.064876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:54.134484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fce7b-6483-4cf2-ad08-40c723d0a26c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.170025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b016-9fef-401b-bf8a-a877ae67641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.170950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b016-9fef-401b-bf8a-a877ae67641c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.171264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b016-9fef-401b-bf8a-a877ae67641c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.171535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b016-9fef-401b-bf8a-a877ae67641c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.183907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76b016-9fef-401b-bf8a-a877ae67641c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.185628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76b016-9fef-401b-bf8a-a877ae67641c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9e76b016-9fef-401b-bf8a-a877ae67641c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:54.204472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:54.205416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:54.206347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:54.206347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:54.206347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:54.206347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:54.206347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 467/941] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:54.212814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.221680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3ad6a-443e-4beb-a2fc-148d03a64c6b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.222018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3ad6a-443e-4beb-a2fc-148d03a64c6b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.222194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3ad6a-443e-4beb-a2fc-148d03a64c6b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.224242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 468/942] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:54.228916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b0043-b2df-4b3a-b36a-a986cbb91b94 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.229152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b0043-b2df-4b3a-b36a-a986cbb91b94 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.229399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b0043-b2df-4b3a-b36a-a986cbb91b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.247346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9b3b0043-b2df-4b3a-b36a-a986cbb91b94 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:54.249343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9b3b0043-b2df-4b3a-b36a-a986cbb91b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:54.332781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fac01-2048-49f8-b0f6-49add79bebfa None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.341669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 469/943] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:54.359023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b0043-b2df-4b3a-b36a-a986cbb91b94 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.370938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.372484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.372937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.373412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.374328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:54.375030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.377350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.379618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:54.396125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 475/944] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:54.401854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.450021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:54.469560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b0043-b2df-4b3a-b36a-a986cbb91b94 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.507271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.508094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.508376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.508651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.509327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.510731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.518309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed492e2-b35f-4a3a-a2c6-1fa8284d745b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:54.523869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:54.524856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:54.525727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 470/945] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:54.532509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.563929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.565267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.565852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.566362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.580656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.582586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:54.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:54.606766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:54.607807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:54.611699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 476/946] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:54.617564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.622605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:54.650428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9aff9-f715-41c0-9ca7-55160c7dcfcc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.700775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.702315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.703035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.703518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.705034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:54.705617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.707832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.720070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 471/947] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:54.721620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.725795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:54.729203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f20da-d9df-4c3b-b78f-3a4f8a6706ad None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.767342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.768106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.768475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.768939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.769804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:54.770242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.771813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.796617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 477/948] 10.222.0.50 () {56 vars in 1149 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:54.797683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.856794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6801367-d995-4aff-88c1-1c13382b6ed3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.899840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.901004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.901472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.902068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.903350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:54.903800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.905413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.917742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 472/949] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:54.918792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:54.924929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42b7a-5c5c-4121-bd20-1b5604c9bc90 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:54.936288 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:54.961761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:54.962798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:54.963140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:54.963493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:54.975029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:54.976728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:54.996616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:54.997596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:54.998761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:54.998761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:54.998761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:54.998761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:55.002782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 478/950] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:55.004168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:55.017865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:55.054157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d9724-92ea-42a5-960a-f87e36373b2e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.100233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08cba8-c9f4-43f0-af78-c908bd4cfbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.101013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cba8-c9f4-43f0-af78-c908bd4cfbd1 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.101638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cba8-c9f4-43f0-af78-c908bd4cfbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.101982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cba8-c9f4-43f0-af78-c908bd4cfbd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.103993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08cba8-c9f4-43f0-af78-c908bd4cfbd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.105569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08cba8-c9f4-43f0-af78-c908bd4cfbd1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.146435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 473/951] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:14:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:55.147107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce754b4-22fa-4516-9f66-71aac93493b7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.148075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321a64-3954-4b18-9477-62d663d59347 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.148412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321a64-3954-4b18-9477-62d663d59347 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.148689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75321a64-3954-4b18-9477-62d663d59347 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.150133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 474/952] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:55.159255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4148143-8a3d-4da4-ae2a-a58fe5f536c0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.159623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4148143-8a3d-4da4-ae2a-a58fe5f536c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.159868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4148143-8a3d-4da4-ae2a-a58fe5f536c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.186452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c4148143-8a3d-4da4-ae2a-a58fe5f536c0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:55.188751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c4148143-8a3d-4da4-ae2a-a58fe5f536c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:55.201169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.202128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.202466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.203017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.203477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:55.203796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.205171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.219515 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 479/953] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:55.225672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:55.272794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:55.289689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 475/954] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:55.308445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4148143-8a3d-4da4-ae2a-a58fe5f536c0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:55.316394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:55.367795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074ea3e-9574-49d1-8312-e3d8dbc05920 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.414205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.415503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.415780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.416209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.425139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.427278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.438475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4148143-8a3d-4da4-ae2a-a58fe5f536c0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:14:55.445534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:55.446742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:55.448158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 480/955] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:55.452994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:55.482174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.483464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.483735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.484272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.484925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.486783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:55.501461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:55.502685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:55.504002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 476/956] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:14:55.511082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:55.584465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36dd80-2e4e-4843-b695-f1d4096083c1 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.592343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:55.625102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:55.635516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.636530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.637028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.637568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.638612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:55.639980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.641743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.643794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113d3db-0475-476e-be61-7b3554fdd881 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.656228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 481/957] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:55.662098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:55.693359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.694308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.694605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.694878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.695984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:55.696317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.697982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.706371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 477/958] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:55.712356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:55.778192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160d831-42c6-40a1-8a07-3155ebea314a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.823285 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7c70e-1ca5-4910-b046-7097a00d9cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.824267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c70e-1ca5-4910-b046-7097a00d9cd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.824593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c70e-1ca5-4910-b046-7097a00d9cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.824892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7c70e-1ca5-4910-b046-7097a00d9cd3 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/c2841ffed5bb4257b20a5e88271d6979/roles/b76995da93e340c78515bc83dde12343` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.827932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7c70e-1ca5-4910-b046-7097a00d9cd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=c2841ffed5bb4257b20a5e88271d6979, role_id=b76995da93e340c78515bc83dde12343)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.830501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7c70e-1ca5-4910-b046-7097a00d9cd3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.834579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310abc9-6a37-4e25-ae63-44b2dd1b172f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:55.850352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 482/959] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:14:55 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/c2841ffed5bb4257b20a5e88271d6979/roles/b76995da93e340c78515bc83dde12343 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:14:55.882266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:55.887064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced588da-ad6f-4de3-bc6e-bb64a09e129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:55.888154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced588da-ad6f-4de3-bc6e-bb64a09e129a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.888739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced588da-ad6f-4de3-bc6e-bb64a09e129a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.889355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced588da-ad6f-4de3-bc6e-bb64a09e129a None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:55.890496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced588da-ad6f-4de3-bc6e-bb64a09e129a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:55.891135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced588da-ad6f-4de3-bc6e-bb64a09e129a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:55.892872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced588da-ad6f-4de3-bc6e-bb64a09e129a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:55.904763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 478/960] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:14:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:55.997820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d508951-8eba-48cb-b21e-e12cac6df02a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:55.998477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d508951-8eba-48cb-b21e-e12cac6df02a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:55.998897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d508951-8eba-48cb-b21e-e12cac6df02a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:56.000922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 483/961] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:56.007032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795be92-179c-40a0-afec-a80777df5054 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:56.007466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795be92-179c-40a0-afec-a80777df5054 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:56.007897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795be92-179c-40a0-afec-a80777df5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:56.026456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c795be92-179c-40a0-afec-a80777df5054 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:56.027848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c795be92-179c-40a0-afec-a80777df5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:56.102798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 479/962] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:56.128116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d508951-8eba-48cb-b21e-e12cac6df02a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:56.176606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:56.233910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d508951-8eba-48cb-b21e-e12cac6df02a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:56.270251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:56.270961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:56.271244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:56.271517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:56.272228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:56.273659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:56.275007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING keystone.server.flask.common [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 17:14:56.288782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.sql.core [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 17:14:56.288782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 17:14:56.288782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [parameters: {'user_id': '44c93632d4f5438480eb126cbb948cae', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 17:14:56.288782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80315) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 12 17:14:56.306841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 17:14:56.307849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application yield resource Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application next(self.gen) Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise self.value Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application session.commit() Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 17:14:56.308787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.session.flush() Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application compat.raise_( Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 17:14:56.309675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 17:14:56.310732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application conn.query(q) Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application result.read() Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 17:14:56.311592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [parameters: {'user_id': '44c93632d4f5438480eb126cbb948cae', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:56.312755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 17:14:56.313592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 17:14:56.317276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 17:14:56.317276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 17:14:56.317276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 17:14:56.317276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 17:14:56.317276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 17:14:56.317276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:56.317276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 484/963] 10.222.0.50 () {60 vars in 1131 bytes} [Tue Jul 12 17:14:56 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:56.317750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795be92-179c-40a0-afec-a80777df5054 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:56.431209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795be92-179c-40a0-afec-a80777df5054 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:56.452903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:56.473469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b2aed-4cdc-4fe9-b677-8d7cec2d0a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:56.474310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b2aed-4cdc-4fe9-b677-8d7cec2d0a05 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:56.474657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b2aed-4cdc-4fe9-b677-8d7cec2d0a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:56.474933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b2aed-4cdc-4fe9-b677-8d7cec2d0a05 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:56.482259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b2aed-4cdc-4fe9-b677-8d7cec2d0a05 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:56.483902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b2aed-4cdc-4fe9-b677-8d7cec2d0a05 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-462b2aed-4cdc-4fe9-b677-8d7cec2d0a05 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:56.498863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:56.499859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:56.501248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 480/964] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:14:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:56.506448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:56.616963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c0e0c-af55-4d14-aa63-3b457b41188b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:56.626784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:56.652457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9af881-40ac-4b96-99fe-719f28e2bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:56.653661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af881-40ac-4b96-99fe-719f28e2bc96 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:56.653952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af881-40ac-4b96-99fe-719f28e2bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:56.654547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9af881-40ac-4b96-99fe-719f28e2bc96 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:56.655760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9af881-40ac-4b96-99fe-719f28e2bc96 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:56.656568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9af881-40ac-4b96-99fe-719f28e2bc96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:56.658231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9af881-40ac-4b96-99fe-719f28e2bc96 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:56.696326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 485/965] 10.222.0.50 () {56 vars in 1101 bytes} [Tue Jul 12 17:14:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:57.307577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694c61b-3c11-40e9-96be-e3c4a0bb4eed None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:57.308127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694c61b-3c11-40e9-96be-e3c4a0bb4eed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:57.308127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694c61b-3c11-40e9-96be-e3c4a0bb4eed None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:57.309642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 481/966] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:57.315101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf366b-dffd-4dfb-88f7-382c97bef8a7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:57.315611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf366b-dffd-4dfb-88f7-382c97bef8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:57.315611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf366b-dffd-4dfb-88f7-382c97bef8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:57.333202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3caf366b-dffd-4dfb-88f7-382c97bef8a7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:57.334755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3caf366b-dffd-4dfb-88f7-382c97bef8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:57.404740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 486/967] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:57.427130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694c61b-3c11-40e9-96be-e3c4a0bb4eed None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:57.532793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694c61b-3c11-40e9-96be-e3c4a0bb4eed None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:57.572368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:57.573540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:57.574019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:57.574759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:57.575635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:57.577529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:57.590817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:57.591852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:14:57.592745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:57.594301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 482/968] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:14:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:57.599653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf366b-dffd-4dfb-88f7-382c97bef8a7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:57.697962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:57.704557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf366b-dffd-4dfb-88f7-382c97bef8a7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:57.742886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:57.743559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:57.743840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:57.744121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:57.744824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:57.745130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:57.746538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:57.751885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 487/969] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:57.757532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:57.803955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:57.864074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a094f-4267-40bf-869f-f42de1f292db None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:57.899320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c70f0a-43a8-4747-a627-6b95c0c3501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:57.899991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70f0a-43a8-4747-a627-6b95c0c3501c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:57.900274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70f0a-43a8-4747-a627-6b95c0c3501c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:57.900529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70f0a-43a8-4747-a627-6b95c0c3501c None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:57.901258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70f0a-43a8-4747-a627-6b95c0c3501c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:57.901561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70f0a-43a8-4747-a627-6b95c0c3501c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:57.902990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c70f0a-43a8-4747-a627-6b95c0c3501c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:57.908309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 483/970] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:14:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:57.914140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:57.976361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc760795-29bf-45da-8db9-5a572553bc02 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:57.976617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc760795-29bf-45da-8db9-5a572553bc02 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:57.976900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc760795-29bf-45da-8db9-5a572553bc02 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:57.978309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 484/971] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:14:57.983383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0424-a555-4369-b812-865c31ca514d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:57.983675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0424-a555-4369-b812-865c31ca514d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:57.983938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0424-a555-4369-b812-865c31ca514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.001008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5a5d0424-a555-4369-b812-865c31ca514d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:58.002195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a5d0424-a555-4369-b812-865c31ca514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:58.031079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaceca6-71fe-4f47-b92c-af2fbdfc8d97 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:58.065642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:58.066427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.066721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.066994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.067792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] RBAC: Adding query filter params (interface=admin, service_id=8c2669b4eccf4b06a3491f8a7d425fe7, region_id=RegionOne) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:58.068106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:58.068579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 485/972] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:14:58.069493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:58.069986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef877270-77c4-4b47-8023-c2d2e1b8d529 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.070278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef877270-77c4-4b47-8023-c2d2e1b8d529 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.070578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef877270-77c4-4b47-8023-c2d2e1b8d529 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.072086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 486/973] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:14:58.079521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 488/974] 10.222.0.50 () {56 vars in 1249 bytes} [Tue Jul 12 17:14:57 2022] GET /identity/v3/endpoints?service_id=8c2669b4eccf4b06a3491f8a7d425fe7&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:58.083241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:58.083614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375c52-1ea6-443e-abc7-03f291cd6f2e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.083906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375c52-1ea6-443e-abc7-03f291cd6f2e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.084181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375c52-1ea6-443e-abc7-03f291cd6f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.101169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ac375c52-1ea6-443e-abc7-03f291cd6f2e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:14:58.102410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ac375c52-1ea6-443e-abc7-03f291cd6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:14:58.108111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:58.131308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:58.169573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 487/975] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:14:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:14:58.170547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac375c52-1ea6-443e-abc7-03f291cd6f2e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:58.190471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286577b-23a6-46b5-8834-e0cfe20a3201 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:58.224588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:58.225309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.225577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.225849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.226576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:58.227939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:58.234021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 489/976] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:14:58 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:14:58.234811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:58.281885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac375c52-1ea6-443e-abc7-03f291cd6f2e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:58.324580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:58.325420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.325787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.326062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.336727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:58.338467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:14:58.346992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:58.348021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:58.348863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 488/977] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Jul 12 17:14:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:58.353850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58af46-e4d7-4f5a-9d7b-6c6915bc821c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:58.354526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:58.385719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:58.393787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:58.394501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.395341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.395341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.395791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:58.397171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:58.412852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 490/978] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:14:58 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:14:58.470180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f00783-8cef-4001-9750-e69f2ad369b6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:58.516106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:58.516806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.517085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.517350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.518109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:58.518451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:58.519853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:58.529359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 489/979] 10.222.0.50 () {56 vars in 1115 bytes} [Tue Jul 12 17:14:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:14:58.543085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:58.655874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70be6a-24e3-4155-8a11-9a74e5306f1b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:58.690170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:58.691007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.691294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.691564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.702905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:58.704360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:58.714218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:58.723693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:58.724681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:58.725590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:58.725590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:58.725590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:58.725590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:58.725590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 491/980] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:58.731016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:58.818618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:58.835631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c284bb-5b62-4a1b-b649-dcd1b1201e5a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:58.869215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e794-be13-401b-b149-b4de12af984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:58.869886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e794-be13-401b-b149-b4de12af984e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:58.870168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e794-be13-401b-b149-b4de12af984e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:58.870474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292e794-be13-401b-b149-b4de12af984e None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:58.871204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e794-be13-401b-b149-b4de12af984e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:58.871506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e794-be13-401b-b149-b4de12af984e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:58.872893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292e794-be13-401b-b149-b4de12af984e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:58.885345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 490/981] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:58.890946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:58.999520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b5f85-fd2a-4a47-892c-e95429aa8e5d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:59.035231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:59.036060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:59.036324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:59.036594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:59.045126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:59.046642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:14:59.061056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:59.062035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:14:59.067347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 492/982] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:14:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:59.070218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e794-be13-401b-b149-b4de12af984e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:59.177909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292e794-be13-401b-b149-b4de12af984e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:59.214126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:59.214645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:59.215002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:59.215260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:59.216143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:59.216529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:59.218670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:59.236871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 491/983] 10.222.0.50 () {56 vars in 1149 bytes} [Tue Jul 12 17:14:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:59.242771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:59.309288 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:59.354037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544e8a9-3a21-44bf-8c21-504e657858dd None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:59.391454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:59.392117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:59.392396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:59.392630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:59.462147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:59.463658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:59.522020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:59.566987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 493/984] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:14:59 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:14:59.572502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:59.577342 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:14:59.681136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a34061-b802-400c-95e5-69bed6026585 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:59.715178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:59.715991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:59.716269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:59.716542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:59.726991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:59.728435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:14:59.746475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:14:59.747386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:14:59.748427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:14:59.748427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:14:59.748427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:14:59.748427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:14:59.748427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 492/985] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:14:59.755004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:59.856692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685aeef2-b321-43c6-a7ff-afa5849efc09 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:14:59.892744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:14:59.893417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:14:59.893706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:14:59.893973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:14:59.894728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:14:59.895036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:14:59.896418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:14:59.908818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 494/986] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:14:59.914313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:14:59.971967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:00.020099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0791038-05db-45cd-ac96-2ca9ad9beee0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.054052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.054899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.055180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.055450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.062773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.064239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:15:00.078881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:00.079820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:00.080826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:00.082388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 493/987] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:00.085988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.110402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:00.194518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724845-0d5d-4916-86c0-bc1e35552880 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.229443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bec3a5-8b19-43f2-8156-ede1f156e823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.230141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bec3a5-8b19-43f2-8156-ede1f156e823 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.230455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bec3a5-8b19-43f2-8156-ede1f156e823 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.230730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bec3a5-8b19-43f2-8156-ede1f156e823 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.231520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bec3a5-8b19-43f2-8156-ede1f156e823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:00.231826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bec3a5-8b19-43f2-8156-ede1f156e823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.233583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bec3a5-8b19-43f2-8156-ede1f156e823 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.246473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 495/988] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:00.252488 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.295880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a8a0-262d-4bbb-975e-d64d1ba4fc44 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.296225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a8a0-262d-4bbb-975e-d64d1ba4fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.296434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825a8a0-262d-4bbb-975e-d64d1ba4fc44 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.298206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 496/989] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:00.303588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2922-b877-4f69-9a3f-c2b580a824da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.303971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2922-b877-4f69-9a3f-c2b580a824da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.304256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2922-b877-4f69-9a3f-c2b580a824da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.321555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-660a2922-b877-4f69-9a3f-c2b580a824da None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:00.322816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-660a2922-b877-4f69-9a3f-c2b580a824da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:00.363213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca9e30-f9f4-46d6-aa04-18d3b330c266 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.379319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:00.395296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 497/990] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:15:00.408065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ff1aa-af96-4c87-8332-4418d22fcdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.408735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff1aa-af96-4c87-8332-4418d22fcdaf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.409016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff1aa-af96-4c87-8332-4418d22fcdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.409289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff1aa-af96-4c87-8332-4418d22fcdaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.410128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ff1aa-af96-4c87-8332-4418d22fcdaf None admin] RBAC: Adding query filter params (role.id=b76995da93e340c78515bc83dde12343, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=c2841ffed5bb4257b20a5e88271d6979) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:00.410470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ff1aa-af96-4c87-8332-4418d22fcdaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.411906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ff1aa-af96-4c87-8332-4418d22fcdaf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.418091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a2922-b877-4f69-9a3f-c2b580a824da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.418239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 494/991] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/role_assignments?user.id=c2841ffed5bb4257b20a5e88271d6979&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b76995da93e340c78515bc83dde12343 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:00.434693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:00.453574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c94ba2-b6a0-4e78-a154-a31f639e1065 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.454197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c94ba2-b6a0-4e78-a154-a31f639e1065 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.454584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c94ba2-b6a0-4e78-a154-a31f639e1065 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.456587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 495/992] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:15:00.461919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66352473-1da8-4ba3-9232-0e350cbc745f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.462247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66352473-1da8-4ba3-9232-0e350cbc745f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.462509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66352473-1da8-4ba3-9232-0e350cbc745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.480211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-66352473-1da8-4ba3-9232-0e350cbc745f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:00.481440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-66352473-1da8-4ba3-9232-0e350cbc745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:00.535348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a2922-b877-4f69-9a3f-c2b580a824da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.556864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 496/993] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:15:00.572423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.573242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.573513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.573791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.577523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.577523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.579126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66352473-1da8-4ba3-9232-0e350cbc745f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:00.591426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:00.592777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 17:15:00.593616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:00.594428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 498/994] 10.222.0.50 () {56 vars in 1126 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:00.600432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.681900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:00.696260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66352473-1da8-4ba3-9232-0e350cbc745f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.706791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:00.709344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7da9b-6654-441b-ab45-ada6e774afc6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.734193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.735129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.735522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.735794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.736448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.737927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.743453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.744130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.744445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.744681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.745419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:00.745726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.747119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:00.750467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:00.751672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:00.753073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 497/995] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:00.756113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 499/996] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:00.757465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.761420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.862219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61900406-2043-49f7-a7d7-a65656e4a667 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.866022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab732f-cc99-47f8-b4ea-c37bda21287f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:00.900055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.900826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.901114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.901563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.902327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:00.902672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.903863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:00.903989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.904776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:00.905465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:00.905751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:00.906905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:00.907218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:00.908893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:00.909766 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 498/997] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:00.915275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.918015 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 500/998] 10.222.0.50 () {56 vars in 1122 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:00.923771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:00.926685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:00.955718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:01.025862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfdf8-e137-4dcb-87e4-3bb8d6f25599 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:01.029338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1ef8-a709-49bc-bbc4-00560010a1ca None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:01.062794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:01.063772 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:01.064281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:01.064408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:01.064857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:01.065033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:01.065318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:01.065597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:01.066320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:01.066423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:01.066960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:01.067746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:01.068675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:01.075749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 499/999] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:15:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:01.081605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:01.089523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 501/1000] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:15:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:15:01.199819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:01.204171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994241-e8a6-4815-91cf-cbe68e4d0029 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:01.251423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c934805-1bcf-4537-b8fe-36bcabe3c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:01.252034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934805-1bcf-4537-b8fe-36bcabe3c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:01.253255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934805-1bcf-4537-b8fe-36bcabe3c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:01.253255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c934805-1bcf-4537-b8fe-36bcabe3c9f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:01.253424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934805-1bcf-4537-b8fe-36bcabe3c9f9 None admin] RBAC: Adding query filter params (interface=public, service_id=8accc2f1bbc14c0bad4e8c1bbe2f9aa8, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:01.253701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934805-1bcf-4537-b8fe-36bcabe3c9f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:01.255528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c934805-1bcf-4537-b8fe-36bcabe3c9f9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:01.260757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 500/1001] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:15:01 2022] GET /identity/v3/endpoints?service_id=8accc2f1bbc14c0bad4e8c1bbe2f9aa8&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:01.267067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:01.333318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:01.390072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee50a98-1161-4668-83b7-68f386928af2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:01.430631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb799a3-7d8c-4bae-884d-d4f24b6a0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:01.431453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb799a3-7d8c-4bae-884d-d4f24b6a0abb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:01.431642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb799a3-7d8c-4bae-884d-d4f24b6a0abb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:01.431901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb799a3-7d8c-4bae-884d-d4f24b6a0abb None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:01.432637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb799a3-7d8c-4bae-884d-d4f24b6a0abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:01.434014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb799a3-7d8c-4bae-884d-d4f24b6a0abb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:01.446313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 502/1002] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:15:01 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:15:02.458099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40502-63f2-4ab9-bfcb-6ce4126d922e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:02.458689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40502-63f2-4ab9-bfcb-6ce4126d922e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:02.458689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40502-63f2-4ab9-bfcb-6ce4126d922e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:02.460193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 501/1003] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:02.465211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3758ae6-1c10-4cd6-ac15-6504c1c0ab7f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:02.465617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3758ae6-1c10-4cd6-ac15-6504c1c0ab7f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:02.465786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3758ae6-1c10-4cd6-ac15-6504c1c0ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:02.482974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e3758ae6-1c10-4cd6-ac15-6504c1c0ab7f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:02.484138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e3758ae6-1c10-4cd6-ac15-6504c1c0ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:02.555039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 503/1004] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:02 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:02.578718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d40502-63f2-4ab9-bfcb-6ce4126d922e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:02.687112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d40502-63f2-4ab9-bfcb-6ce4126d922e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:02.721759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:02.722498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:02.722780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:02.723139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:02.723785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:02.725151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:02.737143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:02.738919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:02.740734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:02.743812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 502/1005] 10.222.0.50 () {56 vars in 1105 bytes} [Tue Jul 12 17:15:02 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:02.745012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3758ae6-1c10-4cd6-ac15-6504c1c0ab7f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:02.800587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:02.844774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3758ae6-1c10-4cd6-ac15-6504c1c0ab7f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:02.878540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb436d8e-ac56-4987-801d-3f1a3d9c25ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:02.879206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb436d8e-ac56-4987-801d-3f1a3d9c25ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:02.879484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb436d8e-ac56-4987-801d-3f1a3d9c25ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:02.879749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb436d8e-ac56-4987-801d-3f1a3d9c25ed None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:02.880449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb436d8e-ac56-4987-801d-3f1a3d9c25ed None admin] RBAC: Adding query filter params (name=image) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:02.880752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb436d8e-ac56-4987-801d-3f1a3d9c25ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:02.882114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb436d8e-ac56-4987-801d-3f1a3d9c25ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:02.887263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 504/1006] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:02.893111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:02.921076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:02.999538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435ed20-13ae-44be-99df-0fdd833c291e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:03.036352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7f552-54de-4c27-8610-1e1057603d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:03.037026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7f552-54de-4c27-8610-1e1057603d15 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.037305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7f552-54de-4c27-8610-1e1057603d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.037574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7f552-54de-4c27-8610-1e1057603d15 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.038306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7f552-54de-4c27-8610-1e1057603d15 None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:03.038617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7f552-54de-4c27-8610-1e1057603d15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:03.039997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7f552-54de-4c27-8610-1e1057603d15 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:03.045758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 503/1007] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:03.150335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319847-6a5d-414e-bb55-000d21900ed4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.150693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319847-6a5d-414e-bb55-000d21900ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.150882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de319847-6a5d-414e-bb55-000d21900ed4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.152468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 505/1008] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:03.158680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b93f5-f989-4e51-bb60-a3e2d41eeefb None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.159024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b93f5-f989-4e51-bb60-a3e2d41eeefb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.159255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b93f5-f989-4e51-bb60-a3e2d41eeefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.178335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-849b93f5-f989-4e51-bb60-a3e2d41eeefb None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:03.179585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-849b93f5-f989-4e51-bb60-a3e2d41eeefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:03.257672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 504/1009] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:03.277847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de319847-6a5d-414e-bb55-000d21900ed4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:03.386549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de319847-6a5d-414e-bb55-000d21900ed4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:03.408708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:03.425214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0376d73-de8e-4ca8-9290-d31230e816d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:03.426076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376d73-de8e-4ca8-9290-d31230e816d1 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.426402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376d73-de8e-4ca8-9290-d31230e816d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.426677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0376d73-de8e-4ca8-9290-d31230e816d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.427872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0376d73-de8e-4ca8-9290-d31230e816d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:03.429350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0376d73-de8e-4ca8-9290-d31230e816d1 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:03.431188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 506/1010] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:03.437316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b93f5-f989-4e51-bb60-a3e2d41eeefb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:03.457191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:03.507274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7ee0-54f5-42b3-ab4e-775be7925c8a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.507898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7ee0-54f5-42b3-ab4e-775be7925c8a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.507898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7ee0-54f5-42b3-ab4e-775be7925c8a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.509387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 507/1011] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:15:03.514738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2b4b4-c7e0-4cec-83e9-29a6b45b307a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.515271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2b4b4-c7e0-4cec-83e9-29a6b45b307a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.515697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2b4b4-c7e0-4cec-83e9-29a6b45b307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.532723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-27b2b4b4-c7e0-4cec-83e9-29a6b45b307a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:03.533914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-27b2b4b4-c7e0-4cec-83e9-29a6b45b307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:03.550680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b93f5-f989-4e51-bb60-a3e2d41eeefb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:03.591289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:03.592045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.592352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.592608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.593784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:03.595266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:03.614646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 508/1012] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:15:03.627270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 505/1013] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:15:03 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:03.642361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2b4b4-c7e0-4cec-83e9-29a6b45b307a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:03.751104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2b4b4-c7e0-4cec-83e9-29a6b45b307a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:03.771580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:03.793945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:03.794796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.795077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.795348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.796016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:03.797394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:03.809700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:03.810808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:03.811672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 509/1014] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:15:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:03.817133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:03.888423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:03.923269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d694a3-5fe0-4951-8e4f-7cbe559378ff None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:03.958754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:03.959429 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:03.959699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:03.959965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:03.960667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:03.960965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:03.962355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:03.967492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 506/1015] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:15:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:03.972881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:04.073740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc7079-5605-4500-839c-33cbbde7816c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:04.107565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e003abc-a67c-43da-80be-ebc25a2fa992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:04.108241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e003abc-a67c-43da-80be-ebc25a2fa992 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:04.108520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e003abc-a67c-43da-80be-ebc25a2fa992 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:04.108789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e003abc-a67c-43da-80be-ebc25a2fa992 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:04.109492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e003abc-a67c-43da-80be-ebc25a2fa992 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:04.109796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e003abc-a67c-43da-80be-ebc25a2fa992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:04.111205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e003abc-a67c-43da-80be-ebc25a2fa992 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:04.116999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 510/1016] 10.222.0.50 () {56 vars in 1112 bytes} [Tue Jul 12 17:15:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:04.122481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:04.227212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af76add-7fc5-4a6b-a84e-8aceb3d759f3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:04.260920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3d584-52a8-4f06-9b58-953bdd73c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:04.261582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d584-52a8-4f06-9b58-953bdd73c934 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:04.261859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d584-52a8-4f06-9b58-953bdd73c934 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:04.262125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3d584-52a8-4f06-9b58-953bdd73c934 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:04.262898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3d584-52a8-4f06-9b58-953bdd73c934 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:04.264479 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3d584-52a8-4f06-9b58-953bdd73c934 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:04.267728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:04.284175 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 507/1017] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:15:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:05.096045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0f134-8b14-400a-90e1-05c453cbe65c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:05.096571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0f134-8b14-400a-90e1-05c453cbe65c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:05.096571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0f134-8b14-400a-90e1-05c453cbe65c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:05.098199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 511/1018] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:05.103591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75d0a-bb92-4808-a008-abe001f76435 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:05.104012 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75d0a-bb92-4808-a008-abe001f76435 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:05.104214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb75d0a-bb92-4808-a008-abe001f76435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:05.122264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2fb75d0a-bb92-4808-a008-abe001f76435 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:05.123780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2fb75d0a-bb92-4808-a008-abe001f76435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:05.202331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 508/1019] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:05 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:05.223517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0f134-8b14-400a-90e1-05c453cbe65c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:05.272363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:05.332179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0f134-8b14-400a-90e1-05c453cbe65c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:05.368528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712c99b-ad01-4329-b25b-4d3a734c9414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:05.369114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c99b-ad01-4329-b25b-4d3a734c9414 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:05.369396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c99b-ad01-4329-b25b-4d3a734c9414 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:05.369669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712c99b-ad01-4329-b25b-4d3a734c9414 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:05.370432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712c99b-ad01-4329-b25b-4d3a734c9414 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:05.371819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712c99b-ad01-4329-b25b-4d3a734c9414 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:05.394328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 512/1020] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:15:05 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:15:05.682815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552626a-c4f4-41a9-95a8-cdf9b01e33a5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:05.683007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552626a-c4f4-41a9-95a8-cdf9b01e33a5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:05.683250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552626a-c4f4-41a9-95a8-cdf9b01e33a5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:05.686321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 509/1021] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:05.690318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985327-dedc-4854-b55d-1cef5c7ca05e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:05.690699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985327-dedc-4854-b55d-1cef5c7ca05e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:05.691041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985327-dedc-4854-b55d-1cef5c7ca05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:05.708323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1d985327-dedc-4854-b55d-1cef5c7ca05e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:05.709514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1d985327-dedc-4854-b55d-1cef5c7ca05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:05.806333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 513/1022] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:05.828862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552626a-c4f4-41a9-95a8-cdf9b01e33a5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:05.939728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552626a-c4f4-41a9-95a8-cdf9b01e33a5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:05.957242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:05.977502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211b00b-8ac5-48f5-b0f8-5372f7d1de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:05.978324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b00b-8ac5-48f5-b0f8-5372f7d1de36 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:05.978624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b00b-8ac5-48f5-b0f8-5372f7d1de36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:05.978895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211b00b-8ac5-48f5-b0f8-5372f7d1de36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:05.980088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211b00b-8ac5-48f5-b0f8-5372f7d1de36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:05.981541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9211b00b-8ac5-48f5-b0f8-5372f7d1de36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:05.983457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 510/1023] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:05.988967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d985327-dedc-4854-b55d-1cef5c7ca05e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:06.021041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:06.100693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d985327-dedc-4854-b55d-1cef5c7ca05e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:06.139326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9079c-39e9-4631-9fcc-567451e2ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:06.140008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9079c-39e9-4631-9fcc-567451e2ad5a None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:06.140359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9079c-39e9-4631-9fcc-567451e2ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:06.140629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9079c-39e9-4631-9fcc-567451e2ad5a None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:06.141353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9079c-39e9-4631-9fcc-567451e2ad5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:06.142834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9079c-39e9-4631-9fcc-567451e2ad5a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:06.174376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 514/1024] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:15:05 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:06.365781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8319fb-6495-4e7f-ac6a-6b6629b7db2b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:06.366359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8319fb-6495-4e7f-ac6a-6b6629b7db2b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:06.366359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8319fb-6495-4e7f-ac6a-6b6629b7db2b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:06.367861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 511/1025] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:06.373898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9b5ec-aa98-4376-8846-7835aad423da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:06.374194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9b5ec-aa98-4376-8846-7835aad423da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:06.374514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9b5ec-aa98-4376-8846-7835aad423da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:06.392050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-41d9b5ec-aa98-4376-8846-7835aad423da None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:06.393245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41d9b5ec-aa98-4376-8846-7835aad423da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:06.462040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 515/1026] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:06.485623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8319fb-6495-4e7f-ac6a-6b6629b7db2b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:06.598592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8319fb-6495-4e7f-ac6a-6b6629b7db2b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:06.636110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:06.636898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:06.637186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:06.637458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:06.648775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:06.657126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:06.658098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:06.658993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 512/1027] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Jul 12 17:15:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:06.666481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9b5ec-aa98-4376-8846-7835aad423da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:06.685898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:06.772486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9b5ec-aa98-4376-8846-7835aad423da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:06.806908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:06.807576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:06.807858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:06.808128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:06.808871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:06.809173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:06.810653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:06.822621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 516/1028] 10.222.0.50 () {56 vars in 1115 bytes} [Tue Jul 12 17:15:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:06.824594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:06.872531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:06.928839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a4cf4-8ab6-48eb-91b9-7646323eb436 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:06.964963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:06.965775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:06.966051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:06.966340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:06.978097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:06.979597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:06.998020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:06.999121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:07.004770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:15:07.004770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:07.004770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:07.004770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:07.004770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 513/1029] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:07.005059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.090137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:07.111003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826771-a551-4ea9-b17e-a2c0513486ed None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:07.145434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:07.146102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.146401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.146669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.147386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:07.147686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:07.149054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:07.161303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 517/1030] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:07.166790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.268928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:07.275463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83264d-7c57-42d5-95fd-c08da6eb1ef6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:07.310510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a920b80-380e-446a-a134-696d481b74fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:07.311304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920b80-380e-446a-a134-696d481b74fa None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.311583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920b80-380e-446a-a134-696d481b74fa None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.311856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a920b80-380e-446a-a134-696d481b74fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.320530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920b80-380e-446a-a134-696d481b74fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:07.322004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a920b80-380e-446a-a134-696d481b74fa None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4a920b80-380e-446a-a134-696d481b74fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:15:07.337613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:07.347002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:07.348470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 514/1031] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:07.350842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.464861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68362e-3f84-4e0b-982e-00ef8f624d96 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:07.478052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20614c2-4d05-47fa-b4f3-47e791b863c4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.478584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20614c2-4d05-47fa-b4f3-47e791b863c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.478584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20614c2-4d05-47fa-b4f3-47e791b863c4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.479990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 515/1032] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:15:07.484948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb3dc-0ef7-4c9a-9de4-00cb12cae5d9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.485239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb3dc-0ef7-4c9a-9de4-00cb12cae5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.485521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb3dc-0ef7-4c9a-9de4-00cb12cae5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.503693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-362bb3dc-0ef7-4c9a-9de4-00cb12cae5d9 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:07.504877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-362bb3dc-0ef7-4c9a-9de4-00cb12cae5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:07.505826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:07.506628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.507283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.507603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.508523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:07.508897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:07.511271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:07.521960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:07.536945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 518/1033] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:07.542397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.585923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 516/1034] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:15:07.610140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb3dc-0ef7-4c9a-9de4-00cb12cae5d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.659428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba283-e8c5-4cd7-9190-e73310915535 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:07.697638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:07.698310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.698610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.698884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.703892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:07.719964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb3dc-0ef7-4c9a-9de4-00cb12cae5d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:07.756112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:07.756925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.757205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.757482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] PATH_INFO: `/v3/services/image` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.758144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:07.759681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:07.771096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:07.771654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:07.772973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:07.775282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 517/1035] 10.222.0.50 () {56 vars in 1105 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:07.778855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.779415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:07.780926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:07.899779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e148ca7-642f-429e-97e0-5b95ae3ffd47 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:07.903152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 519/1036] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 17:15:07.908742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.936810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:07.937847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:07.938445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:07.939009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:07.939905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:07.940418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:07.942112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:07.947897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 518/1037] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:07.953420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:07.970852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.015708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.020193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caf9d1-de69-485f-805c-59e90203ada4 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.056627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.057443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.057725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.058000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.062350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d049b68-7da9-4f9f-8c24-725cc435fdde None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.068234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.069684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:08.088220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:08.089188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:08.090856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:15:08.090856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:08.090856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:08.090856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:08.090856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 520/1038] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:08.095533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.099822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.100500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.100779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.101045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.101748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:08.102038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.103452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.109163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 519/1039] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:08.114863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.204185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1212647-1179-4d93-a286-124fdb93e572 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.220069 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.241384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841faff-dfea-4d02-a635-59c33263f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.242363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841faff-dfea-4d02-a635-59c33263f865 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.242643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841faff-dfea-4d02-a635-59c33263f865 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.242920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841faff-dfea-4d02-a635-59c33263f865 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.243738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841faff-dfea-4d02-a635-59c33263f865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:08.244063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841faff-dfea-4d02-a635-59c33263f865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.245448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841faff-dfea-4d02-a635-59c33263f865 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.246940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7fb8-05d6-4387-b91f-e55d24e96571 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.256988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 521/1040] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:08.258366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4a747-e029-47e3-9e80-17221f3bd5c3 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.258651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4a747-e029-47e3-9e80-17221f3bd5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.258933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4a747-e029-47e3-9e80-17221f3bd5c3 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.260456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 522/1041] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:08.262262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4a747-e029-47e3-9e80-17221f3bd5c3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.274795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.283144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcfb42-924c-4e2e-8af2-94e7869d692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.283823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfb42-924c-4e2e-8af2-94e7869d692f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.284084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfb42-924c-4e2e-8af2-94e7869d692f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.284352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfb42-924c-4e2e-8af2-94e7869d692f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.285139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfb42-924c-4e2e-8af2-94e7869d692f None admin] RBAC: Adding query filter params (interface=public, service_id=e6b4ff11011c4bd7ad3c571c2e30414e, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:08.285445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfb42-924c-4e2e-8af2-94e7869d692f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.286864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfb42-924c-4e2e-8af2-94e7869d692f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.291845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 520/1042] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/endpoints?service_id=e6b4ff11011c4bd7ad3c571c2e30414e&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:08.293034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8411f-7861-4497-9eb2-72886b75f2fd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.293318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8411f-7861-4497-9eb2-72886b75f2fd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.293593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8411f-7861-4497-9eb2-72886b75f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.309441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bfe8411f-7861-4497-9eb2-72886b75f2fd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:08.310726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bfe8411f-7861-4497-9eb2-72886b75f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:08.369212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4a747-e029-47e3-9e80-17221f3bd5c3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.376600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 521/1043] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:08.377496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8411f-7861-4497-9eb2-72886b75f2fd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.405162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.405967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.406246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.406549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.413293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.414797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:15:08.428778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:08.429872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 523/1044] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:08.430844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.454247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.484315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8411f-7861-4497-9eb2-72886b75f2fd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.505854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.520593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.521261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.521548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.521814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.522520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.523886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.530688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 522/1045] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:15:08.531457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.551179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a29b3e-d800-4d46-a87b-222e8dfd1f88 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.600933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.601676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.601959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.602233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.614534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:08.623110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:08.624327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:08.625389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:08.626580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 524/1046] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:08.632830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.653402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e684160-b106-41da-b87b-75f630a2d498 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.696810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.697526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.697809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.698085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.698917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:08.699224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.700658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.704257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.715858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 523/1047] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:08.721776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.748889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0532b-13c6-4af1-bce8-5341055e56d6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.778777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:08.787198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.787881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.788164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.788440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.789187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:08.789492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.790896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.800064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 525/1048] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:08.805250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:08.832683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4de7b6-da20-4d00-af4b-1eb0b820121b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.870329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.871026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.871315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.871593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.872428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] RBAC: Adding query filter params (role.id=b76995da93e340c78515bc83dde12343, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5253b3eec6ae45f3bca9369107c4d93a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:08.872742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.874250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.879942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 524/1049] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/role_assignments?user.id=5253b3eec6ae45f3bca9369107c4d93a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b76995da93e340c78515bc83dde12343 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:08.926126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce40d8-0ffe-48af-954a-c9440e1c833c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:08.964161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:08.965079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:08.965346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:08.965616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] PATH_INFO: `/v3/users/150e9e18b30b415db3c093e1dbb05fce` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:08.981753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] RBAC: Authorizing `identity:get_user(user_id=150e9e18b30b415db3c093e1dbb05fce)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:08.983409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:08.985427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 526/1050] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/users/150e9e18b30b415db3c093e1dbb05fce => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:08.991625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:09.062762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:09.102063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a38dd-cdc9-4ca1-8579-26747b666221 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:09.136736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:09.137309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:09.137587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:09.137860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:09.205457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:09.206951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:09.266075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:09.310183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 525/1051] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:08 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:09.316605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:09.370160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:09.423013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1de31-30df-4d02-b55e-dffd392c20f8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:09.457160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799ed3a-09d4-4a8b-848c-86c8b44df004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:09.458016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ed3a-09d4-4a8b-848c-86c8b44df004 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:09.458308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ed3a-09d4-4a8b-848c-86c8b44df004 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:09.458607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ed3a-09d4-4a8b-848c-86c8b44df004 None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:09.459792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799ed3a-09d4-4a8b-848c-86c8b44df004 None admin] RBAC: Authorizing `identity:get_project(project_id=ebf930fa0479472db389a0742ebadfe7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:09.461233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799ed3a-09d4-4a8b-848c-86c8b44df004 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:09.463149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 527/1052] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:09 2022] GET /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:09.469350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:09.569781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c76348-f74d-4cdd-a719-18d13c73feeb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:09.610437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3dff7a-00d6-44a6-945a-faf8c41f6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:09.611108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dff7a-00d6-44a6-945a-faf8c41f6795 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:09.611383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dff7a-00d6-44a6-945a-faf8c41f6795 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:09.611656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dff7a-00d6-44a6-945a-faf8c41f6795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:09.612489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dff7a-00d6-44a6-945a-faf8c41f6795 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=ebf930fa0479472db389a0742ebadfe7, user.id=150e9e18b30b415db3c093e1dbb05fce) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:09.612799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dff7a-00d6-44a6-945a-faf8c41f6795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:09.614229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3dff7a-00d6-44a6-945a-faf8c41f6795 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:09.620525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 526/1053] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:09 2022] GET /identity/v3/role_assignments?user.id=150e9e18b30b415db3c093e1dbb05fce&scope.project.id=ebf930fa0479472db389a0742ebadfe7&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:10.565985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b2f3-9bb4-4659-b4ea-2fbfb8759759 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:10.566578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b2f3-9bb4-4659-b4ea-2fbfb8759759 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:10.566578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546b2f3-9bb4-4659-b4ea-2fbfb8759759 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:10.568094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 528/1054] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:10.573240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7991-bf63-41da-8427-dd94c7f5ec7a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:10.573773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7991-bf63-41da-8427-dd94c7f5ec7a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:10.573773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7991-bf63-41da-8427-dd94c7f5ec7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:10.594346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b16a7991-bf63-41da-8427-dd94c7f5ec7a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:10.595898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b16a7991-bf63-41da-8427-dd94c7f5ec7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:10.617248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:10.674382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 527/1055] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:10.691809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b2f3-9bb4-4659-b4ea-2fbfb8759759 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:10.800306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546b2f3-9bb4-4659-b4ea-2fbfb8759759 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:10.819727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:10.838325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f2c58-e0f7-4b69-ae3f-43282a158d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:10.839127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2c58-e0f7-4b69-ae3f-43282a158d30 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:10.839403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2c58-e0f7-4b69-ae3f-43282a158d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:10.839674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f2c58-e0f7-4b69-ae3f-43282a158d30 None admin] PATH_INFO: `/v3/services/image` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:10.840320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f2c58-e0f7-4b69-ae3f-43282a158d30 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:10.841715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f2c58-e0f7-4b69-ae3f-43282a158d30 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ef5f2c58-e0f7-4b69-ae3f-43282a158d30 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:10.853096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:10.854072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:10.861688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 529/1056] 10.222.0.50 () {56 vars in 1105 bytes} [Tue Jul 12 17:15:10 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:10.864437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7991-bf63-41da-8427-dd94c7f5ec7a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:10.961103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3933-d6bd-4025-a9fd-905e91f997cb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:10.961441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3933-d6bd-4025-a9fd-905e91f997cb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:10.961652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf3933-d6bd-4025-a9fd-905e91f997cb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:10.963191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 530/1057] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:10.970428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d056b-d7d4-4481-a614-fe15efb4e84e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:10.970428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d056b-d7d4-4481-a614-fe15efb4e84e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:10.970428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d056b-d7d4-4481-a614-fe15efb4e84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:10.978446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7991-bf63-41da-8427-dd94c7f5ec7a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:10.988271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-866d056b-d7d4-4481-a614-fe15efb4e84e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:10.989848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-866d056b-d7d4-4481-a614-fe15efb4e84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:11.019164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.019840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.020123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.020401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.021110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] RBAC: Adding query filter params (name=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:11.021653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:11.022845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:11.027948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 528/1058] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:11.033600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.053014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:11.066571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 531/1059] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:11.082864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d056b-d7d4-4481-a614-fe15efb4e84e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.141359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f51fe-3f55-497f-a0f5-887ec855cb19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.177035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.177701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.177982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.178249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.178977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] RBAC: Adding query filter params (type=image) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:11.179280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:11.180649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:11.185515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 529/1060] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:11.189211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d056b-d7d4-4481-a614-fe15efb4e84e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.191246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.206464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:11.234622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.235711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.235990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.236258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.251163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:11.262794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:11.263850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:11.264693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 532/1061] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Jul 12 17:15:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:11.270017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.277405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:11.301306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc793179-e7b2-4476-8cbb-be58d9717d30 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.340166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.340850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.341131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.341500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.342243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:11.343657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:11.370330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 530/1062] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:15:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:15:11.396847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362123c3-7b35-42c6-a257-4f0e8bdc75ba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.444806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.445482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.445744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.446035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.446921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:11.447234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:11.448678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:11.458968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 533/1063] 10.222.0.50 () {56 vars in 1115 bytes} [Tue Jul 12 17:15:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:11.464792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.575785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67745a67-a6d6-46d6-bc27-989eb9e699b6 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.617835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a925fa-9bf9-4851-9055-075bb4228426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.618699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a925fa-9bf9-4851-9055-075bb4228426 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.618981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a925fa-9bf9-4851-9055-075bb4228426 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.619253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a925fa-9bf9-4851-9055-075bb4228426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.627343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:11.631326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a925fa-9bf9-4851-9055-075bb4228426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:11.632793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a925fa-9bf9-4851-9055-075bb4228426 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f1a925fa-9bf9-4851-9055-075bb4228426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:11.652230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:11.653218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:11.654218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:15:11.654218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:11.654218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:11.654218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:11.654218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 531/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:11.659634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.693301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:11.712412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbde9d-6025-4e9a-908f-a1c24dc52245 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.712752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbde9d-6025-4e9a-908f-a1c24dc52245 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.712976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adbde9d-6025-4e9a-908f-a1c24dc52245 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.718496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 532/1065] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:15:11.719890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726e0a-22ed-432c-bee7-3d343d032565 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.720179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726e0a-22ed-432c-bee7-3d343d032565 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.720455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82726e0a-22ed-432c-bee7-3d343d032565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.738722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-82726e0a-22ed-432c-bee7-3d343d032565 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:11.740020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82726e0a-22ed-432c-bee7-3d343d032565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:11.776537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80392-13e5-4e18-86c5-5ba40a76cc4b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.812323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.813001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.813276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.813579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.814267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:11.814611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:11.816132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:11.821329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 533/1066] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:11.831860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 534/1067] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:11.837804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82726e0a-22ed-432c-bee7-3d343d032565 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.846881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:11.941548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:11.946303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82726e0a-22ed-432c-bee7-3d343d032565 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.954828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad6931-aef4-4b2c-a3e5-2d85740230a5 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:11.969896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:11.985185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.986000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.986301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.986577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.991211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:11.992012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:11.992290 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:11.992555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:11.994640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:11.996120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.002984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:12.010541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:12.011458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:12.017646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:15:12.018331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:12.019224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:15:12.020181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:12.020725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 535/1068] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:12.020794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 534/1069] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:15:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:12.020794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.020925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.122784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fafb5-bed9-4f88-9a30-c8e9b356bd60 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.130437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431cefb-4485-472d-aee5-01320934b94d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.156973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990246-629f-4121-9d55-312c63411afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.157671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990246-629f-4121-9d55-312c63411afe None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.158008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990246-629f-4121-9d55-312c63411afe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.158304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990246-629f-4121-9d55-312c63411afe None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.159157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c990246-629f-4121-9d55-312c63411afe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:12.159471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c990246-629f-4121-9d55-312c63411afe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.160913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c990246-629f-4121-9d55-312c63411afe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.166969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.167646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.167899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.168176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.168950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:12.169258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.170676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.179932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 535/1071] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:12.180076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 536/1071] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:12.185403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990246-629f-4121-9d55-312c63411afe None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.185539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.197398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:12.229954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:12.289261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7600f0-e809-480a-9c29-f4119f086c54 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.298130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990246-629f-4121-9d55-312c63411afe None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.326977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.327886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.328172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.328439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] PATH_INFO: `/v3/users/150e9e18b30b415db3c093e1dbb05fce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.329630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] RBAC: Authorizing `identity:get_user(user_id=150e9e18b30b415db3c093e1dbb05fce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.331093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.332736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 536/1072] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/users/150e9e18b30b415db3c093e1dbb05fce => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:12.333633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.334485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.334770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.335043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.338355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.346425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.347873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:12.369976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:12.370948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:12.371847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:15:12.371847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:12.371847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:12.371847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:12.371847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 537/1073] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:12.376772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.442271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:12.444661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d3219-76bc-4deb-806a-ff436407e049 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.457229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:12.483639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55210f5d-8272-4597-884d-10360103dc7c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.483830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.484740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.485095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.485432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.487411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=ebf930fa0479472db389a0742ebadfe7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.488873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.491155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 537/1074] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:12.497364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.524781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.525458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.525741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.526013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.526774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:12.527082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.528458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.539878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 538/1075] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:12.545540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.617753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66bc4a-ce42-4464-8327-50e72912c8f7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.649830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f393a-ff46-4fbe-81f1-32ac9a040e25 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.653616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.654635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.654918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.655188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7/users/150e9e18b30b415db3c093e1dbb05fce/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.657229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebf930fa0479472db389a0742ebadfe7, user_id=150e9e18b30b415db3c093e1dbb05fce, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.658715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.670882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:12.682406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 538/1076] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:15:12 2022] PUT /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7/users/150e9e18b30b415db3c093e1dbb05fce/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:15:12.687095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.687930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.688214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.688492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.696588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.698054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:15:12.714826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:12.715789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:12.717748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 539/1077] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:12.722257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.769089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:12.838120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ab8c-7b87-4e97-9832-395cc7853d01 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:12.874256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230be649-1728-4f6b-b88e-8edb45977d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:12.874957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230be649-1728-4f6b-b88e-8edb45977d22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:12.875239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230be649-1728-4f6b-b88e-8edb45977d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:12.875511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230be649-1728-4f6b-b88e-8edb45977d22 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:12.876306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230be649-1728-4f6b-b88e-8edb45977d22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:12.876615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230be649-1728-4f6b-b88e-8edb45977d22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:12.878053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230be649-1728-4f6b-b88e-8edb45977d22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:12.890819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 539/1078] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:12.896716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:12.999330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374b0a-fcbd-405c-8c39-7573c31f5688 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:13.034310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b5eee8-de8c-4be2-ac9e-265b01358b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:13.035216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5eee8-de8c-4be2-ac9e-265b01358b62 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:13.035494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5eee8-de8c-4be2-ac9e-265b01358b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:13.035763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5eee8-de8c-4be2-ac9e-265b01358b62 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5253b3eec6ae45f3bca9369107c4d93a/roles/b76995da93e340c78515bc83dde12343` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:13.038008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5eee8-de8c-4be2-ac9e-265b01358b62 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=5253b3eec6ae45f3bca9369107c4d93a, role_id=b76995da93e340c78515bc83dde12343)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:13.039504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b5eee8-de8c-4be2-ac9e-265b01358b62 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:13.054319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 540/1079] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:15:12 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/5253b3eec6ae45f3bca9369107c4d93a/roles/b76995da93e340c78515bc83dde12343 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:15:13.422216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719fbe-e37a-46e8-a7bb-1e044a9c0e63 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:13.422612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719fbe-e37a-46e8-a7bb-1e044a9c0e63 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:13.422803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b719fbe-e37a-46e8-a7bb-1e044a9c0e63 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:13.424344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 540/1080] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:13.429611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb9bd-005c-44ef-84fd-d2df20de97a1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:13.429902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb9bd-005c-44ef-84fd-d2df20de97a1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:13.430174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb9bd-005c-44ef-84fd-d2df20de97a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:13.447583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7b9cb9bd-005c-44ef-84fd-d2df20de97a1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:13.448759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7b9cb9bd-005c-44ef-84fd-d2df20de97a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:13.483948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:13.521274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 541/1081] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:13.543562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b719fbe-e37a-46e8-a7bb-1e044a9c0e63 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:13.653512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:13.659248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b719fbe-e37a-46e8-a7bb-1e044a9c0e63 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:13.695648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:13.696219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:13.696493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:13.696759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:13.769584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:13.771083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:13.871899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:13.877552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 541/1082] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:13.883901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb9bd-005c-44ef-84fd-d2df20de97a1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:13.984487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb9bd-005c-44ef-84fd-d2df20de97a1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:14.017845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24572e-cd44-4367-b302-17ba99fd7a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:14.018677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24572e-cd44-4367-b302-17ba99fd7a1b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:14.018951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24572e-cd44-4367-b302-17ba99fd7a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:14.019221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24572e-cd44-4367-b302-17ba99fd7a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:14.029409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24572e-cd44-4367-b302-17ba99fd7a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:14.030891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24572e-cd44-4367-b302-17ba99fd7a1b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-cf24572e-cd44-4367-b302-17ba99fd7a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:14.048242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:14.049139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:14.050034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:15:14.050034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:14.050034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:14.050034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:14.054337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 542/1083] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:14.055750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:14.162980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef44eb2-f9aa-4190-9cd6-e6480131b097 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:14.199281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5317-3f35-4357-a98d-175026ae3632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:14.199951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5317-3f35-4357-a98d-175026ae3632 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:14.200231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5317-3f35-4357-a98d-175026ae3632 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:14.200498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5317-3f35-4357-a98d-175026ae3632 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:14.201254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d5317-3f35-4357-a98d-175026ae3632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:14.201649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d5317-3f35-4357-a98d-175026ae3632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:14.203056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d5317-3f35-4357-a98d-175026ae3632 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:14.214935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 542/1084] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:14.707753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cca5b-a0fc-4ce8-9f4f-6894b77a04c2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:14.708143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cca5b-a0fc-4ce8-9f4f-6894b77a04c2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:14.708419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cca5b-a0fc-4ce8-9f4f-6894b77a04c2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:14.709816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 543/1085] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:14.715293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114bf00-cc6c-43d1-9440-1bd1b51af57e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:14.715792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114bf00-cc6c-43d1-9440-1bd1b51af57e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:14.715792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114bf00-cc6c-43d1-9440-1bd1b51af57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:14.733264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0114bf00-cc6c-43d1-9440-1bd1b51af57e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:14.734496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0114bf00-cc6c-43d1-9440-1bd1b51af57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:14.796566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:14.811850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 543/1086] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:14.835242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cca5b-a0fc-4ce8-9f4f-6894b77a04c2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:14.861018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:14.941605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cca5b-a0fc-4ce8-9f4f-6894b77a04c2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:14.977457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c49b9-a3cc-411f-bf0a-5ebb60d1d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:14.978251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c49b9-a3cc-411f-bf0a-5ebb60d1d89a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:14.978565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c49b9-a3cc-411f-bf0a-5ebb60d1d89a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:14.978843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c49b9-a3cc-411f-bf0a-5ebb60d1d89a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:14.989556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c49b9-a3cc-411f-bf0a-5ebb60d1d89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1c7c49b9-a3cc-411f-bf0a-5ebb60d1d89a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:14.997520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:14.998632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:14.999618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 544/1087] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:15.005185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114bf00-cc6c-43d1-9440-1bd1b51af57e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.093659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0e92b-80bd-443a-a448-752d6e645119 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.093945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0e92b-80bd-443a-a448-752d6e645119 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.094250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0e92b-80bd-443a-a448-752d6e645119 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.095687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 545/1088] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:15.102525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f3c5-dd5c-4282-9a21-994c1d269cfa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.102923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f3c5-dd5c-4282-9a21-994c1d269cfa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.103315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00f3c5-dd5c-4282-9a21-994c1d269cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.111974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114bf00-cc6c-43d1-9440-1bd1b51af57e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.124666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2b00f3c5-dd5c-4282-9a21-994c1d269cfa None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:15.125852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2b00f3c5-dd5c-4282-9a21-994c1d269cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:15.147149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.147828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.148110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.148377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.149123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:15.149428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.150862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.159753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 544/1089] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:15.165630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.195730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 546/1090] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:15.214951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.219939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00f3c5-dd5c-4282-9a21-994c1d269cfa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.233583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.264660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2f720-5682-4dc1-aadc-740cc3b37cdd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.298090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.299017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.299299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.299572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] PATH_INFO: `/v3/users/150e9e18b30b415db3c093e1dbb05fce` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.300793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] RBAC: Authorizing `identity:get_user(user_id=150e9e18b30b415db3c093e1dbb05fce)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.302251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.303935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 545/1091] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/users/150e9e18b30b415db3c093e1dbb05fce => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:15.309765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.321441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00f3c5-dd5c-4282-9a21-994c1d269cfa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.356291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.357128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.357629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.358036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.368583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:15.376637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:15.377784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:15.379077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 547/1092] 10.222.0.50 () {56 vars in 1120 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:15.383766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.413397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4a39e-ed3a-4907-be3e-ba332f8d15fd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.430337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.447236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.447892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.448173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.448445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.454115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.484004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917b8d-a9f1-40ae-afdc-78c935386f0f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.514607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.516057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.518596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.519269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.519544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.519813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.520555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:15.520856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.522233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.530598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 548/1093] 10.222.0.50 () {56 vars in 1115 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:15.536273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.619928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 546/1094] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 17:15:15.625582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.634449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523b95-5290-479f-bb89-5ef88e504ddb None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.642721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.669095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.669921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.670191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.670494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.672454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.681718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.683190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:15.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:15.701555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:15.702565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:15:15.702565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:15.702565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:15.702565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:15.702565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 549/1095] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:15.707470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.723656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a65ca-aed6-48b7-9bd8-e48c661a1ae9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.757493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.758468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.758759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.759056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.760255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] RBAC: Authorizing `identity:get_project(project_id=ebf930fa0479472db389a0742ebadfe7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.761700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.763477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 547/1096] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:15.770107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.807033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1c64c-71e0-41f5-b5b0-f75175246b6b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.841302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.842056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.842367 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.842645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.843370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:15.843680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.845082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.854832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.856853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 550/1097] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:15.863052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:15.873625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5a1c-1e86-44ff-9b46-b49048353b7a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:15.908335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:15.910498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:15.911163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:15.911440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:15.911697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:15.912510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=ebf930fa0479472db389a0742ebadfe7, user.id=150e9e18b30b415db3c093e1dbb05fce) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:15.912818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:15.914270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:15.920727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 548/1098] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/role_assignments?user.id=150e9e18b30b415db3c093e1dbb05fce&scope.project.id=ebf930fa0479472db389a0742ebadfe7&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:15.964872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd0c6-3c50-4488-86e9-5a501eed7e1c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:16.004826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:16.005645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:16.005929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:16.006250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:16.014548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:16.016018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:15:16.032571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:16.033651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:16.034656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 551/1099] 10.222.0.50 () {56 vars in 1093 bytes} [Tue Jul 12 17:15:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:15:16.040226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:16.144967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d87873-a5fa-4991-810e-83060858adf0 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:16.180176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:16.180904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:16.181184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:16.181455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:16.182325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:16.182650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:16.184132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:16.203609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 549/1100] 10.222.0.50 () {56 vars in 1133 bytes} [Tue Jul 12 17:15:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:16.209476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:16.314154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca664b96-3179-4bb8-964c-82181e1a5351 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:16.322417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:16.350891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:16.351543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:16.351825 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:16.352099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:16.421833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:16.423239 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:16.530181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 552/1101] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:16.536105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:16.547328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:16.640424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e916d9-d7a7-49e2-ad05-5779cf1bd833 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:16.675588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:16.676307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:16.676582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:16.676853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:16.687496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:16.688942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:16.706389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:16.707366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:16.708265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:15:16.708265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:16.708265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:15:16.708265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:16.708265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 550/1102] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:16.713601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:16.722205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:16.817114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0545c-37a5-4ed7-917d-1855f2d94990 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:16.851762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:16.852421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:16.852702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:16.853257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:16.853987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:16.854319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:16.855696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:16.867260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 553/1103] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:16.872971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:16.934085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:16.981412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe54ab-3e06-4314-b167-4d7aad642820 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:17.018864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:17.019646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:17.019929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:17.020205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:17.027047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:17.028508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:15:17.042588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:17.043489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:17.044397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 551/1104] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:15:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:17.050580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:17.118746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:17.158478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d6b8a-ec94-4fdf-8f64-5d46b0159831 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:17.193291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a0120-c55c-4414-9f93-c982bd373797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:17.193877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a0120-c55c-4414-9f93-c982bd373797 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:17.194152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a0120-c55c-4414-9f93-c982bd373797 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:17.194447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a0120-c55c-4414-9f93-c982bd373797 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:17.195224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a0120-c55c-4414-9f93-c982bd373797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:17.195523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a0120-c55c-4414-9f93-c982bd373797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:17.197006 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a0120-c55c-4414-9f93-c982bd373797 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:17.209099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 554/1105] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:17.215237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:17.320530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88ae7-0950-4a07-acc1-bde1645354cd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:17.339765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:17.353821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac9f18-6548-440a-b9cd-bcf39fc507d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:17.354511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9f18-6548-440a-b9cd-bcf39fc507d6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:17.354790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9f18-6548-440a-b9cd-bcf39fc507d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:17.355055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac9f18-6548-440a-b9cd-bcf39fc507d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:17.355873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac9f18-6548-440a-b9cd-bcf39fc507d6 None admin] RBAC: Adding query filter params (role.id=b76995da93e340c78515bc83dde12343, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=5253b3eec6ae45f3bca9369107c4d93a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:17.356179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac9f18-6548-440a-b9cd-bcf39fc507d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:17.357690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac9f18-6548-440a-b9cd-bcf39fc507d6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:17.363496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 552/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:17 2022] GET /identity/v3/role_assignments?user.id=5253b3eec6ae45f3bca9369107c4d93a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b76995da93e340c78515bc83dde12343 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:17.986736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70405e1-9c4e-4c7d-834e-81e25f6e4380 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:17.986933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70405e1-9c4e-4c7d-834e-81e25f6e4380 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:17.987236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70405e1-9c4e-4c7d-834e-81e25f6e4380 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:17.988625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 555/1107] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:17.994640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7855f6d-0c0b-426c-a5f8-97ca70630dcf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:17.995110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7855f6d-0c0b-426c-a5f8-97ca70630dcf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:17.995215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7855f6d-0c0b-426c-a5f8-97ca70630dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:18.012855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a7855f6d-0c0b-426c-a5f8-97ca70630dcf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:18.014107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a7855f6d-0c0b-426c-a5f8-97ca70630dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:18.085614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 553/1108] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:15:18.110469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70405e1-9c4e-4c7d-834e-81e25f6e4380 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:18.218805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70405e1-9c4e-4c7d-834e-81e25f6e4380 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:18.246929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:18.262090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577795-31c7-4968-8306-7345f47d5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:18.263345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577795-31c7-4968-8306-7345f47d5812 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:18.263701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577795-31c7-4968-8306-7345f47d5812 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:18.264044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577795-31c7-4968-8306-7345f47d5812 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:18.266259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577795-31c7-4968-8306-7345f47d5812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:18.268710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577795-31c7-4968-8306-7345f47d5812 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:18.271407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 556/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:18.280392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7855f6d-0c0b-426c-a5f8-97ca70630dcf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:18.387499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7855f6d-0c0b-426c-a5f8-97ca70630dcf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:18.401791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:18.425312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53400b9-1ee1-4fee-b3e1-f80f8ce4e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:18.425977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53400b9-1ee1-4fee-b3e1-f80f8ce4e60d None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:18.426254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53400b9-1ee1-4fee-b3e1-f80f8ce4e60d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:18.426549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53400b9-1ee1-4fee-b3e1-f80f8ce4e60d None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:18.427254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53400b9-1ee1-4fee-b3e1-f80f8ce4e60d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:18.428683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53400b9-1ee1-4fee-b3e1-f80f8ce4e60d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:18.451115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 554/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:15:18 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:20.477578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80726-dd84-4f20-9e71-e46a16bf3a3a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:20.478535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80726-dd84-4f20-9e71-e46a16bf3a3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:20.478535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e80726-dd84-4f20-9e71-e46a16bf3a3a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:20.480705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 557/1111] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:20.487154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3c24-daf9-4fed-bffc-01fe83393ddc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:20.487821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3c24-daf9-4fed-bffc-01fe83393ddc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:20.488017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb3c24-daf9-4fed-bffc-01fe83393ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:20.510019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-85cb3c24-daf9-4fed-bffc-01fe83393ddc None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:20.511288 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-85cb3c24-daf9-4fed-bffc-01fe83393ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:20.594366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 555/1112] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:20.618278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80726-dd84-4f20-9e71-e46a16bf3a3a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:20.734393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e80726-dd84-4f20-9e71-e46a16bf3a3a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:20.769572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:20.770452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:20.770717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:20.770983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] PATH_INFO: `/v3/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:20.772547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] RBAC: Authorizing `identity:get_role(role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:20.773912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:20.775310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 558/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:20 2022] GET /identity/v3/roles/e2809f949125439eb6f73ac31122b973 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:20.784490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3c24-daf9-4fed-bffc-01fe83393ddc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:20.887134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:20.891519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb3c24-daf9-4fed-bffc-01fe83393ddc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:20.929795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:20.930709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:20.930996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:20.931269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] PATH_INFO: `/v3/users/1f5b52e0d84f4f9ab7cb225025ae6daa` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:20.945512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] RBAC: Authorizing `identity:get_user(user_id=1f5b52e0d84f4f9ab7cb225025ae6daa)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:20.947087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:20.948764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 556/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:20 2022] GET /identity/v3/users/1f5b52e0d84f4f9ab7cb225025ae6daa => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:20.955694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:21.027270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:21.068058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d412b37-6359-4369-a7d3-b7d1f160f78f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:21.102763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:21.103402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:21.103680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:21.103945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:21.171679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:21.173113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:21.233271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:21.273336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 559/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:21.279616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:21.390541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa605bd-9641-493c-9e93-c476940482cf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:21.424978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e99177-a430-4833-93bb-29aedfaa24e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:21.425829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99177-a430-4833-93bb-29aedfaa24e4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:21.426102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99177-a430-4833-93bb-29aedfaa24e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:21.426392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e99177-a430-4833-93bb-29aedfaa24e4 None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:21.427612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99177-a430-4833-93bb-29aedfaa24e4 None admin] RBAC: Authorizing `identity:get_project(project_id=ebf930fa0479472db389a0742ebadfe7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:21.429037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e99177-a430-4833-93bb-29aedfaa24e4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:21.430760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 557/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:21 2022] GET /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:21.437061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:21.579626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f93a5-dc12-4c01-83c7-a4eb5db59567 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:21.617186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdcefc-c632-4a92-a66b-31fff3ab50ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:21.617845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdcefc-c632-4a92-a66b-31fff3ab50ad None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:21.618128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdcefc-c632-4a92-a66b-31fff3ab50ad None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:21.618426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdcefc-c632-4a92-a66b-31fff3ab50ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:21.619261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdcefc-c632-4a92-a66b-31fff3ab50ad None admin] RBAC: Adding query filter params (role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=ebf930fa0479472db389a0742ebadfe7, user.id=1f5b52e0d84f4f9ab7cb225025ae6daa) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:21.619566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdcefc-c632-4a92-a66b-31fff3ab50ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:21.620985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cdcefc-c632-4a92-a66b-31fff3ab50ad None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:21.626704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 560/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:21 2022] GET /identity/v3/role_assignments?user.id=1f5b52e0d84f4f9ab7cb225025ae6daa&scope.project.id=ebf930fa0479472db389a0742ebadfe7&role.id=e2809f949125439eb6f73ac31122b973 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:23.667472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559395b7-7f39-4f73-ad45-7b4399cf0bf1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:23.668314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559395b7-7f39-4f73-ad45-7b4399cf0bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:23.668314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559395b7-7f39-4f73-ad45-7b4399cf0bf1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:23.670699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 558/1118] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:23.676997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a77e6-983a-450a-901d-89ca1f317e46 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:23.677459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a77e6-983a-450a-901d-89ca1f317e46 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:23.677559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a77e6-983a-450a-901d-89ca1f317e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:23.703868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e51a77e6-983a-450a-901d-89ca1f317e46 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:23.705065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e51a77e6-983a-450a-901d-89ca1f317e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:23.726035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:23.777383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 561/1119] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:23.800427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559395b7-7f39-4f73-ad45-7b4399cf0bf1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:23.839753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:23.922420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559395b7-7f39-4f73-ad45-7b4399cf0bf1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:23.958424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:23.959289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:23.959568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:23.959842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] PATH_INFO: `/v3/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:23.961448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] RBAC: Authorizing `identity:get_role(role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:23.962873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:23.964258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 559/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:23 2022] GET /identity/v3/roles/e2809f949125439eb6f73ac31122b973 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:23.973109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a77e6-983a-450a-901d-89ca1f317e46 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:24.092732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a77e6-983a-450a-901d-89ca1f317e46 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:24.127830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:24.128696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:24.128969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:24.129239 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] PATH_INFO: `/v3/users/1f5b52e0d84f4f9ab7cb225025ae6daa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:24.130468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] RBAC: Authorizing `identity:get_user(user_id=1f5b52e0d84f4f9ab7cb225025ae6daa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:24.131900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:24.133525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 562/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:23 2022] GET /identity/v3/users/1f5b52e0d84f4f9ab7cb225025ae6daa => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:24.142249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:24.254620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:24.261868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7031b-665a-47dd-ae55-3afbe7344a48 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:24.297525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f0eea-7a3a-41c3-bce8-85926fcab27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:24.298410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0eea-7a3a-41c3-bce8-85926fcab27e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:24.298687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0eea-7a3a-41c3-bce8-85926fcab27e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:24.298952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f0eea-7a3a-41c3-bce8-85926fcab27e None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:24.300246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f0eea-7a3a-41c3-bce8-85926fcab27e None admin] RBAC: Authorizing `identity:get_project(project_id=ebf930fa0479472db389a0742ebadfe7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:24.301679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f0eea-7a3a-41c3-bce8-85926fcab27e None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:24.303392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 560/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:24 2022] GET /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:24.313060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:24.345938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:24.428082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c6c32-62ac-40ed-a8e1-0fbe8c7ec10f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:24.462503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0a661-03b3-4c8e-a4d6-2123479d60fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:24.463377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0a661-03b3-4c8e-a4d6-2123479d60fe None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:24.463649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0a661-03b3-4c8e-a4d6-2123479d60fe None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:24.463895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0a661-03b3-4c8e-a4d6-2123479d60fe None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7/users/1f5b52e0d84f4f9ab7cb225025ae6daa/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:24.466126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0a661-03b3-4c8e-a4d6-2123479d60fe None admin] RBAC: Authorizing `identity:create_grant(project_id=ebf930fa0479472db389a0742ebadfe7, user_id=1f5b52e0d84f4f9ab7cb225025ae6daa, role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:24.467608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0a661-03b3-4c8e-a4d6-2123479d60fe None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:24.482562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 563/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:15:24 2022] PUT /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7/users/1f5b52e0d84f4f9ab7cb225025ae6daa/roles/e2809f949125439eb6f73ac31122b973 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:15:26.434421 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80c65-0272-48a3-8b35-c955766130fe None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:26.435389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80c65-0272-48a3-8b35-c955766130fe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:26.435619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac80c65-0272-48a3-8b35-c955766130fe None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:26.438184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 561/1124] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:26.444491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912f65-8338-4aab-b4a9-2cf9b6733eac None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:26.445257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912f65-8338-4aab-b4a9-2cf9b6733eac None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:26.445396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f912f65-8338-4aab-b4a9-2cf9b6733eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:26.470577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0f912f65-8338-4aab-b4a9-2cf9b6733eac None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:26.471781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f912f65-8338-4aab-b4a9-2cf9b6733eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:26.547751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 564/1125] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:26.583536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac80c65-0272-48a3-8b35-c955766130fe None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:26.710437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac80c65-0272-48a3-8b35-c955766130fe None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:26.759408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:26.760692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:26.761118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:26.761544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] PATH_INFO: `/v3/roles/e2809f949125439eb6f73ac31122b973` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:26.764052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] RBAC: Authorizing `identity:get_role(role_id=e2809f949125439eb6f73ac31122b973)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:26.765439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:26.766942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 562/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:26 2022] GET /identity/v3/roles/e2809f949125439eb6f73ac31122b973 => generated 223 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:26.773126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f912f65-8338-4aab-b4a9-2cf9b6733eac None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:26.788583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:26.875498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f912f65-8338-4aab-b4a9-2cf9b6733eac None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:26.912411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:26.913284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:26.913564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:26.913839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] PATH_INFO: `/v3/users/1f5b52e0d84f4f9ab7cb225025ae6daa` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:26.915165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] RBAC: Authorizing `identity:get_user(user_id=1f5b52e0d84f4f9ab7cb225025ae6daa)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:26.916604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:26.918244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 565/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:26 2022] GET /identity/v3/users/1f5b52e0d84f4f9ab7cb225025ae6daa => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:15:26.924552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:26.957233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:27.039039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0dd06-3dd0-4190-a29b-61f67a384982 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:27.076071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:27.076711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:27.076987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:27.077259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:27.153320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:27.154833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:27.185670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:27.259874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 563/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:27.269727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:27.359696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:27.378941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd05f01-84a6-421e-96e2-494e91e3e18d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:27.415209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc7f80-24d0-4b8f-b835-c7afc197e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:27.416080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7f80-24d0-4b8f-b835-c7afc197e884 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:27.416365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7f80-24d0-4b8f-b835-c7afc197e884 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:27.416642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc7f80-24d0-4b8f-b835-c7afc197e884 None admin] PATH_INFO: `/v3/projects/ebf930fa0479472db389a0742ebadfe7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:27.417870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc7f80-24d0-4b8f-b835-c7afc197e884 None admin] RBAC: Authorizing `identity:get_project(project_id=ebf930fa0479472db389a0742ebadfe7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:27.419361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc7f80-24d0-4b8f-b835-c7afc197e884 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:27.421299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 566/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:27 2022] GET /identity/v3/projects/ebf930fa0479472db389a0742ebadfe7 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:27.427670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:27.533745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191cdb5b-c2cd-4923-92aa-9792ff77ead9 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:27.563448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:27.570252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07346c90-e2c3-48d6-86ea-68a2b31179e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:27.570936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346c90-e2c3-48d6-86ea-68a2b31179e7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:27.571221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346c90-e2c3-48d6-86ea-68a2b31179e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:27.571500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07346c90-e2c3-48d6-86ea-68a2b31179e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:27.572324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07346c90-e2c3-48d6-86ea-68a2b31179e7 None admin] RBAC: Adding query filter params (role.id=e2809f949125439eb6f73ac31122b973, scope.project.id=ebf930fa0479472db389a0742ebadfe7, user.id=1f5b52e0d84f4f9ab7cb225025ae6daa) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:27.572632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07346c90-e2c3-48d6-86ea-68a2b31179e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:27.574071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07346c90-e2c3-48d6-86ea-68a2b31179e7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:27.581032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 564/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:27 2022] GET /identity/v3/role_assignments?user.id=1f5b52e0d84f4f9ab7cb225025ae6daa&scope.project.id=ebf930fa0479472db389a0742ebadfe7&role.id=e2809f949125439eb6f73ac31122b973 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:29.632428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa09fe-e8d3-4349-8797-74e676dd0029 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:29.632897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa09fe-e8d3-4349-8797-74e676dd0029 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:29.633025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa09fe-e8d3-4349-8797-74e676dd0029 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:29.634394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 567/1131] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:29.640690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d31c4e-6255-44b5-8208-071cc5027564 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:29.641420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d31c4e-6255-44b5-8208-071cc5027564 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:29.641574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d31c4e-6255-44b5-8208-071cc5027564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:29.669155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-41d31c4e-6255-44b5-8208-071cc5027564 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:29.670652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-41d31c4e-6255-44b5-8208-071cc5027564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:29.758402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 565/1132] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:29.782244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa09fe-e8d3-4349-8797-74e676dd0029 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:29.891859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa09fe-e8d3-4349-8797-74e676dd0029 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:29.927251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef4938-e2e1-4ace-846b-991579c39a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:29.928044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef4938-e2e1-4ace-846b-991579c39a86 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:29.928320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef4938-e2e1-4ace-846b-991579c39a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:29.928592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef4938-e2e1-4ace-846b-991579c39a86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:29.929893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef4938-e2e1-4ace-846b-991579c39a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:29.931366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef4938-e2e1-4ace-846b-991579c39a86 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:29.932973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 568/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:29.939961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d31c4e-6255-44b5-8208-071cc5027564 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:30.052828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d31c4e-6255-44b5-8208-071cc5027564 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:30.076790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:30.095022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cb933-9385-4bfd-9cee-9793ece5ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:30.095696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb933-9385-4bfd-9cee-9793ece5ea23 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:30.095978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb933-9385-4bfd-9cee-9793ece5ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:30.096249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb933-9385-4bfd-9cee-9793ece5ea23 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:30.096962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cb933-9385-4bfd-9cee-9793ece5ea23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:30.098456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cb933-9385-4bfd-9cee-9793ece5ea23 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:30.127269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 566/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:15:29 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:32.186714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219ba0-3c91-4db8-a8a7-5aca8d13df13 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:32.187630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219ba0-3c91-4db8-a8a7-5aca8d13df13 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:32.187630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23219ba0-3c91-4db8-a8a7-5aca8d13df13 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:32.189772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 569/1135] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:32.195249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0283f-0eec-4412-9529-8c95998fc560 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:32.195682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0283f-0eec-4412-9529-8c95998fc560 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:32.195773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0283f-0eec-4412-9529-8c95998fc560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:32.214433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c5f0283f-0eec-4412-9529-8c95998fc560 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:32.215622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5f0283f-0eec-4412-9529-8c95998fc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:32.284952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 567/1136] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:32.309686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23219ba0-3c91-4db8-a8a7-5aca8d13df13 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:32.343147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:32.441554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23219ba0-3c91-4db8-a8a7-5aca8d13df13 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:32.476464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1db208-f9f8-493a-b53c-124ecc8d598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:32.477244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db208-f9f8-493a-b53c-124ecc8d598b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:32.477523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db208-f9f8-493a-b53c-124ecc8d598b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:32.477783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1db208-f9f8-493a-b53c-124ecc8d598b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:32.479075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1db208-f9f8-493a-b53c-124ecc8d598b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:32.480502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1db208-f9f8-493a-b53c-124ecc8d598b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:32.482115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 570/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:32.491811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0283f-0eec-4412-9529-8c95998fc560 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:32.596565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0283f-0eec-4412-9529-8c95998fc560 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:32.604025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:32.631785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abd052-812b-4be4-9b2b-89c1e6afbee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:32.632458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abd052-812b-4be4-9b2b-89c1e6afbee3 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:32.632738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abd052-812b-4be4-9b2b-89c1e6afbee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:32.633000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abd052-812b-4be4-9b2b-89c1e6afbee3 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:32.633692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abd052-812b-4be4-9b2b-89c1e6afbee3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:32.635148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abd052-812b-4be4-9b2b-89c1e6afbee3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:32.656721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 568/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:15:32 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:34.824253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe82f-41f9-4470-8e94-d0090c8796c8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:34.824844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe82f-41f9-4470-8e94-d0090c8796c8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:34.824844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fe82f-41f9-4470-8e94-d0090c8796c8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:34.826238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 571/1139] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:34.832878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43abb4-7907-496d-9b78-3e4cb611fea1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:34.833590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43abb4-7907-496d-9b78-3e4cb611fea1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:34.833764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43abb4-7907-496d-9b78-3e4cb611fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:34.860811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fd43abb4-7907-496d-9b78-3e4cb611fea1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:34.861915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fd43abb4-7907-496d-9b78-3e4cb611fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:34.932606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 569/1140] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:34.964940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe82f-41f9-4470-8e94-d0090c8796c8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:35.055513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:35.073617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fe82f-41f9-4470-8e94-d0090c8796c8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:35.116677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:35.117374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:35.117658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:35.117929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:35.128675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:35.136303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:35.137434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:35.138694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 572/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:35.144716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43abb4-7907-496d-9b78-3e4cb611fea1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:35.244834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:35.257142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43abb4-7907-496d-9b78-3e4cb611fea1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:35.295952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:35.296616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:35.296905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:35.297176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:35.297931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:35.298237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:35.299657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:35.307901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 570/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:35.315289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:35.431991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdb1f1-3314-4a0e-8bea-57c8414c30f9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:35.466563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:35.467474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:35.467758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:35.468026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] PATH_INFO: `/v3/users/9a6b4d4daa364392b2ff0dfc81db98a5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:35.481629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] RBAC: Authorizing `identity:get_user(user_id=9a6b4d4daa364392b2ff0dfc81db98a5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:35.483183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:35.484862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 573/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:35 2022] GET /identity/v3/users/9a6b4d4daa364392b2ff0dfc81db98a5 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:35.491356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:35.611173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bb5a7-1faa-47e5-8ae0-f222508dccb1 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:35.647420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:35.648075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:35.648359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:35.648626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:35.677124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:35.733155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:35.734560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:35.836974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 571/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:35.843266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:35.847449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:35.946251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5ff5c-06f9-4210-afb6-bceb86126802 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:35.981611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7034a-cc2a-4ffe-8226-cc3199cb686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:35.982514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7034a-cc2a-4ffe-8226-cc3199cb686c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:35.982792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7034a-cc2a-4ffe-8226-cc3199cb686c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:35.983089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7034a-cc2a-4ffe-8226-cc3199cb686c None admin] PATH_INFO: `/v3/projects/7505cfc0b431462f8e99b010c40c5313` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:35.984473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7034a-cc2a-4ffe-8226-cc3199cb686c None admin] RBAC: Authorizing `identity:get_project(project_id=7505cfc0b431462f8e99b010c40c5313)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:35.985859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7034a-cc2a-4ffe-8226-cc3199cb686c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:35.987602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 574/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:35 2022] GET /identity/v3/projects/7505cfc0b431462f8e99b010c40c5313 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:35.994444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:36.048605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:36.096415 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fca213-8b4c-41b4-91c5-952bc7d81bef None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:36.136212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b60398-cdb6-442f-819a-d44b078e4b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:36.137176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60398-cdb6-442f-819a-d44b078e4b36 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:36.137454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60398-cdb6-442f-819a-d44b078e4b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:36.137724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b60398-cdb6-442f-819a-d44b078e4b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:36.138664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b60398-cdb6-442f-819a-d44b078e4b36 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=7505cfc0b431462f8e99b010c40c5313, user.id=9a6b4d4daa364392b2ff0dfc81db98a5) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:36.139051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b60398-cdb6-442f-819a-d44b078e4b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:36.140490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b60398-cdb6-442f-819a-d44b078e4b36 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:36.146404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 572/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:35 2022] GET /identity/v3/role_assignments?user.id=9a6b4d4daa364392b2ff0dfc81db98a5&scope.project.id=7505cfc0b431462f8e99b010c40c5313&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:38.116183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b7f02-83aa-4d60-bd80-e676c9baaa2d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:38.117022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b7f02-83aa-4d60-bd80-e676c9baaa2d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:38.117022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b7f02-83aa-4d60-bd80-e676c9baaa2d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:38.119373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 575/1147] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:38.125673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b7d2-f534-41b5-a64f-ebd848975e7c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:38.126450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b7d2-f534-41b5-a64f-ebd848975e7c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:38.126614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8b7d2-f534-41b5-a64f-ebd848975e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:38.149208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e9f8b7d2-f534-41b5-a64f-ebd848975e7c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:38.150641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e9f8b7d2-f534-41b5-a64f-ebd848975e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:38.223538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 573/1148] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:38.247837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b7f02-83aa-4d60-bd80-e676c9baaa2d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:38.338997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:38.373184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b7f02-83aa-4d60-bd80-e676c9baaa2d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:38.408578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:38.409369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:38.409651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:38.409919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:38.420077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:38.427812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:38.428871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:38.429758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 576/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:38.435469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b7d2-f534-41b5-a64f-ebd848975e7c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:38.489324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:38.551317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8b7d2-f534-41b5-a64f-ebd848975e7c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:38.588399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:38.589068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:38.589345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:38.589612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:38.590395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:38.590698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:38.592117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:38.600756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 574/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:38.606781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:38.711168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c691-1489-43ef-989a-bc047e18d600 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:38.741134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:38.747272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:38.748150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:38.748487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:38.748765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] PATH_INFO: `/v3/users/9a6b4d4daa364392b2ff0dfc81db98a5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:38.749965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] RBAC: Authorizing `identity:get_user(user_id=9a6b4d4daa364392b2ff0dfc81db98a5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:38.751456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:38.753069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 577/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:38 2022] GET /identity/v3/users/9a6b4d4daa364392b2ff0dfc81db98a5 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:38.759264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:38.877672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c4e58-acce-455b-9e96-e4e1bdefbdb3 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:38.889329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:38.920035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306dfa3-7af1-4af8-9d39-5e7593c586c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:38.921369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306dfa3-7af1-4af8-9d39-5e7593c586c6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:38.921663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306dfa3-7af1-4af8-9d39-5e7593c586c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:38.921936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306dfa3-7af1-4af8-9d39-5e7593c586c6 None admin] PATH_INFO: `/v3/projects/7505cfc0b431462f8e99b010c40c5313` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:38.923233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306dfa3-7af1-4af8-9d39-5e7593c586c6 None admin] RBAC: Authorizing `identity:get_project(project_id=7505cfc0b431462f8e99b010c40c5313)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:38.924685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306dfa3-7af1-4af8-9d39-5e7593c586c6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:38.926416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 575/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:38 2022] GET /identity/v3/projects/7505cfc0b431462f8e99b010c40c5313 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:38.932759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:39.036317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e369bb-e2aa-4a30-9562-10749c6da91c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:39.071122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1078-94f1-4764-bb77-fd75b160aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:39.072003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1078-94f1-4764-bb77-fd75b160aa07 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:39.072279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1078-94f1-4764-bb77-fd75b160aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:39.072549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1078-94f1-4764-bb77-fd75b160aa07 None admin] PATH_INFO: `/v3/projects/7505cfc0b431462f8e99b010c40c5313/users/9a6b4d4daa364392b2ff0dfc81db98a5/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:39.074751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1078-94f1-4764-bb77-fd75b160aa07 None admin] RBAC: Authorizing `identity:create_grant(project_id=7505cfc0b431462f8e99b010c40c5313, user_id=9a6b4d4daa364392b2ff0dfc81db98a5, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:39.076186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1078-94f1-4764-bb77-fd75b160aa07 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:39.094517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 578/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:15:38 2022] PUT /identity/v3/projects/7505cfc0b431462f8e99b010c40c5313/users/9a6b4d4daa364392b2ff0dfc81db98a5/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:15:41.090731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da68c5-763b-4643-ac83-e55b0bbf063c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:41.091307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da68c5-763b-4643-ac83-e55b0bbf063c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:41.091307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da68c5-763b-4643-ac83-e55b0bbf063c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:41.092931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 576/1154] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:41.099396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2439d-6c93-445b-88eb-a3404bce9b5e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:41.100111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2439d-6c93-445b-88eb-a3404bce9b5e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:41.100249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2439d-6c93-445b-88eb-a3404bce9b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:41.122704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2ad2439d-6c93-445b-88eb-a3404bce9b5e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:41.124042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2ad2439d-6c93-445b-88eb-a3404bce9b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:41.188346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:41.205342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 579/1155] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:41.233459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da68c5-763b-4643-ac83-e55b0bbf063c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:41.350276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da68c5-763b-4643-ac83-e55b0bbf063c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:41.384063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:41.384854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:41.385141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:41.385412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:41.395739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:41.403467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:41.404598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:41.406016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 577/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:41.411473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2439d-6c93-445b-88eb-a3404bce9b5e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:41.525575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2439d-6c93-445b-88eb-a3404bce9b5e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:41.561001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:41.561668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:41.561952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:41.562223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:41.563004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:41.563314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:41.564670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:41.573970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 580/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:41.580124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:41.629141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:41.696986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bd718-d05c-44f1-a02f-39e87ef67488 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:41.741183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:41.742064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:41.742434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:41.742706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] PATH_INFO: `/v3/users/9a6b4d4daa364392b2ff0dfc81db98a5` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:41.743922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] RBAC: Authorizing `identity:get_user(user_id=9a6b4d4daa364392b2ff0dfc81db98a5)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:41.745368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:41.747049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 578/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:41 2022] GET /identity/v3/users/9a6b4d4daa364392b2ff0dfc81db98a5 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:41.753007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:41.810746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:41.859101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91319a4d-1d69-426f-9509-a43f184b7e0d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:41.894530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:41.895118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:41.895391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:41.895664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:41.966652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:41.968143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:42.020297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:42.068966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 581/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:42.075118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:42.199798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1000f-3066-44d1-a220-a7bbbbfb719c None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:42.207704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:42.241072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891694a7-5ff4-47c5-9e26-97b5803a3dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:42.241947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891694a7-5ff4-47c5-9e26-97b5803a3dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:42.242227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891694a7-5ff4-47c5-9e26-97b5803a3dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:42.242529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891694a7-5ff4-47c5-9e26-97b5803a3dc6 None admin] PATH_INFO: `/v3/projects/7505cfc0b431462f8e99b010c40c5313` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:42.243724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891694a7-5ff4-47c5-9e26-97b5803a3dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=7505cfc0b431462f8e99b010c40c5313)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:42.245173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891694a7-5ff4-47c5-9e26-97b5803a3dc6 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:42.246938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 579/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:42 2022] GET /identity/v3/projects/7505cfc0b431462f8e99b010c40c5313 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:42.258098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:42.369613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd923a3d-4de5-45f7-a234-a5c5d58991c6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:42.405982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a49fa-665b-4a79-b8cc-3a1278119657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:42.406658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a49fa-665b-4a79-b8cc-3a1278119657 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:42.406941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a49fa-665b-4a79-b8cc-3a1278119657 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:42.407213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a49fa-665b-4a79-b8cc-3a1278119657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:42.408038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a49fa-665b-4a79-b8cc-3a1278119657 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=7505cfc0b431462f8e99b010c40c5313, user.id=9a6b4d4daa364392b2ff0dfc81db98a5) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:42.408354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a49fa-665b-4a79-b8cc-3a1278119657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:42.409784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a49fa-665b-4a79-b8cc-3a1278119657 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:42.415851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 582/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:42 2022] GET /identity/v3/role_assignments?user.id=9a6b4d4daa364392b2ff0dfc81db98a5&scope.project.id=7505cfc0b431462f8e99b010c40c5313&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:44.486532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d382fbc-67ab-4110-b0af-66dea5ce61c4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:44.487382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d382fbc-67ab-4110-b0af-66dea5ce61c4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:44.487382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d382fbc-67ab-4110-b0af-66dea5ce61c4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:44.489577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 580/1162] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:44.495383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6b8d1-a243-4473-b6d9-5a4be5605cf6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:44.495799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6b8d1-a243-4473-b6d9-5a4be5605cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:44.495889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6b8d1-a243-4473-b6d9-5a4be5605cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:44.515452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f7c6b8d1-a243-4473-b6d9-5a4be5605cf6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:44.516647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f7c6b8d1-a243-4473-b6d9-5a4be5605cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:44.527284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:44.589135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 583/1163] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:44.612863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d382fbc-67ab-4110-b0af-66dea5ce61c4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:44.739171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d382fbc-67ab-4110-b0af-66dea5ce61c4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:44.775960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:44.776604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:44.776891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:44.777163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:44.822156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:44.850006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:44.851498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:44.964898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 581/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:44.971685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6b8d1-a243-4473-b6d9-5a4be5605cf6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:45.075528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6b8d1-a243-4473-b6d9-5a4be5605cf6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:45.123721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc6c0d-bf88-45b2-abdc-acc331119220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:45.124522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc6c0d-bf88-45b2-abdc-acc331119220 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:45.124807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc6c0d-bf88-45b2-abdc-acc331119220 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:45.125070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc6c0d-bf88-45b2-abdc-acc331119220 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:45.132082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc6c0d-bf88-45b2-abdc-acc331119220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:45.133538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc6c0d-bf88-45b2-abdc-acc331119220 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0ffc6c0d-bf88-45b2-abdc-acc331119220 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:45.147884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:45.149050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:15:45.149935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 584/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:15:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:45.156011 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:45.246246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:45.273845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062e16f-c8fa-46ed-bd45-7ea725205586 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:45.309108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d5be5-b7ab-405d-b99a-6858d1f4c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:45.309765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5be5-b7ab-405d-b99a-6858d1f4c891 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:45.310039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5be5-b7ab-405d-b99a-6858d1f4c891 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:45.310327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5be5-b7ab-405d-b99a-6858d1f4c891 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:45.311167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d5be5-b7ab-405d-b99a-6858d1f4c891 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:45.311470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d5be5-b7ab-405d-b99a-6858d1f4c891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:45.312843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d5be5-b7ab-405d-b99a-6858d1f4c891 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:45.320109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 582/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Tue Jul 12 17:15:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:47.359501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699e5f-0859-4a3d-9d0b-1a5f4ebf72b1 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:47.360070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699e5f-0859-4a3d-9d0b-1a5f4ebf72b1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:47.360070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699e5f-0859-4a3d-9d0b-1a5f4ebf72b1 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:47.361469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 585/1167] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:47.368270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25470b9b-d371-41eb-a1a8-d99fda172b24 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:47.368983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25470b9b-d371-41eb-a1a8-d99fda172b24 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:47.369155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25470b9b-d371-41eb-a1a8-d99fda172b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:47.390575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-25470b9b-d371-41eb-a1a8-d99fda172b24 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:47.391772 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-25470b9b-d371-41eb-a1a8-d99fda172b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:47.464187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 583/1168] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:47.500762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699e5f-0859-4a3d-9d0b-1a5f4ebf72b1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:47.511673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:47.625527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699e5f-0859-4a3d-9d0b-1a5f4ebf72b1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:47.664516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ee5f5-3e43-4656-8760-5eb72c7a055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:47.665184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ee5f5-3e43-4656-8760-5eb72c7a055d None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:47.665466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ee5f5-3e43-4656-8760-5eb72c7a055d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:47.665737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ee5f5-3e43-4656-8760-5eb72c7a055d None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:47.666513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ee5f5-3e43-4656-8760-5eb72c7a055d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:47.667885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ee5f5-3e43-4656-8760-5eb72c7a055d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:47.694459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 586/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Tue Jul 12 17:15:47 2022] POST /identity/v3/domains => generated 267 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:49.736694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631c69-f59e-4d24-8ae9-c250d0f1086d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:49.737576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631c69-f59e-4d24-8ae9-c250d0f1086d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:49.737576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32631c69-f59e-4d24-8ae9-c250d0f1086d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:49.740314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 584/1170] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:49.745669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13549aa5-7e74-4b5d-8a8b-3b5ef5cece1b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:49.746086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13549aa5-7e74-4b5d-8a8b-3b5ef5cece1b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:49.746196 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13549aa5-7e74-4b5d-8a8b-3b5ef5cece1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:49.764166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-13549aa5-7e74-4b5d-8a8b-3b5ef5cece1b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:49.765372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13549aa5-7e74-4b5d-8a8b-3b5ef5cece1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:49.827748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:49.836751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 587/1171] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:49.869347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631c69-f59e-4d24-8ae9-c250d0f1086d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:49.942054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:49.981707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32631c69-f59e-4d24-8ae9-c250d0f1086d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:50.017098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b668c9-e757-4d62-ae18-545b6ec1259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:50.017962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b668c9-e757-4d62-ae18-545b6ec1259b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:50.018239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b668c9-e757-4d62-ae18-545b6ec1259b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:50.018535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b668c9-e757-4d62-ae18-545b6ec1259b None admin] PATH_INFO: `/v3/domains/85658775b6304e699cc72c3bf2abc7d3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:50.029405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b668c9-e757-4d62-ae18-545b6ec1259b None admin] RBAC: Authorizing `identity:get_domain(domain_id=85658775b6304e699cc72c3bf2abc7d3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:50.030924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b668c9-e757-4d62-ae18-545b6ec1259b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:50.032557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 585/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Tue Jul 12 17:15:49 2022] GET /identity/v3/domains/85658775b6304e699cc72c3bf2abc7d3 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:50.041656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13549aa5-7e74-4b5d-8a8b-3b5ef5cece1b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:50.146403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13549aa5-7e74-4b5d-8a8b-3b5ef5cece1b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:50.181411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3544b-413e-4a62-9aef-46f74b2690e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:50.182061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3544b-413e-4a62-9aef-46f74b2690e8 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:50.182331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3544b-413e-4a62-9aef-46f74b2690e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:50.182635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3544b-413e-4a62-9aef-46f74b2690e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:50.183339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3544b-413e-4a62-9aef-46f74b2690e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:50.184772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3544b-413e-4a62-9aef-46f74b2690e8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:50.214435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 588/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:15:50 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:52.253380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22735e-d5fc-4ce2-b8e9-adabd6d7d00b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:52.254360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22735e-d5fc-4ce2-b8e9-adabd6d7d00b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:52.254360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22735e-d5fc-4ce2-b8e9-adabd6d7d00b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:52.256473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 586/1174] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:52.264374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab7cc6-5bf9-4cf9-b5c1-d9bafdabe03e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:52.264835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab7cc6-5bf9-4cf9-b5c1-d9bafdabe03e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:52.264944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab7cc6-5bf9-4cf9-b5c1-d9bafdabe03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:52.284312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0bab7cc6-5bf9-4cf9-b5c1-d9bafdabe03e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:52.285488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0bab7cc6-5bf9-4cf9-b5c1-d9bafdabe03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:52.335557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:52.368568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 589/1175] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:15:52.393425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22735e-d5fc-4ce2-b8e9-adabd6d7d00b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:52.511829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22735e-d5fc-4ce2-b8e9-adabd6d7d00b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:52.540915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:52.549918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3612a-e279-4a44-912b-1e1ba5a3c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:52.550827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3612a-e279-4a44-912b-1e1ba5a3c133 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:52.551105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3612a-e279-4a44-912b-1e1ba5a3c133 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:52.551376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3612a-e279-4a44-912b-1e1ba5a3c133 None admin] PATH_INFO: `/v3/domains/85658775b6304e699cc72c3bf2abc7d3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:52.552610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3612a-e279-4a44-912b-1e1ba5a3c133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=85658775b6304e699cc72c3bf2abc7d3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:52.554059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3612a-e279-4a44-912b-1e1ba5a3c133 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:52.555702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 587/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Tue Jul 12 17:15:52 2022] GET /identity/v3/domains/85658775b6304e699cc72c3bf2abc7d3 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:52.562064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab7cc6-5bf9-4cf9-b5c1-d9bafdabe03e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:52.669776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab7cc6-5bf9-4cf9-b5c1-d9bafdabe03e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:52.706913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654e53a-3d4b-402b-8fd2-6a17d00d775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:52.707570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654e53a-3d4b-402b-8fd2-6a17d00d775f None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:52.707848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654e53a-3d4b-402b-8fd2-6a17d00d775f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:52.708117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654e53a-3d4b-402b-8fd2-6a17d00d775f None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:52.708787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654e53a-3d4b-402b-8fd2-6a17d00d775f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:52.710241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654e53a-3d4b-402b-8fd2-6a17d00d775f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:52.735165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 590/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:15:52 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:15:54.820190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ada2a4-7515-440e-a340-acf8af057079 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:54.821077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ada2a4-7515-440e-a340-acf8af057079 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:54.821077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ada2a4-7515-440e-a340-acf8af057079 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:54.823321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 588/1178] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:54.829749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f585f1-f622-4ac6-a2b4-ab112e3a3181 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:54.830516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f585f1-f622-4ac6-a2b4-ab112e3a3181 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:54.830699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f585f1-f622-4ac6-a2b4-ab112e3a3181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:54.853447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-79f585f1-f622-4ac6-a2b4-ab112e3a3181 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:54.854598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-79f585f1-f622-4ac6-a2b4-ab112e3a3181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:54.883378 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:54.932920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 591/1179] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:54.956327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ada2a4-7515-440e-a340-acf8af057079 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:55.082268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ada2a4-7515-440e-a340-acf8af057079 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:55.119294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:55.120015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:55.120294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:55.120570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:55.130810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:55.138493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:55.139753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:55.141273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 589/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:55.146810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f585f1-f622-4ac6-a2b4-ab112e3a3181 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:55.262255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f585f1-f622-4ac6-a2b4-ab112e3a3181 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:55.297511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:55.298165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:55.298469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:55.298739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:55.299488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:55.299790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:55.301158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:55.309247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 592/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:55.318372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:55.378490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:55.424150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2600c-6d78-4e95-b167-52ff7eff6f0d None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:55.461645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:55.462551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:55.462829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:55.463104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] PATH_INFO: `/v3/users/564d9453aab940f5ae0b22997a19c577` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:55.477275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] RBAC: Authorizing `identity:get_user(user_id=564d9453aab940f5ae0b22997a19c577)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:55.478776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:55.480431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 590/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:55 2022] GET /identity/v3/users/564d9453aab940f5ae0b22997a19c577 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:55.487179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:55.520618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:55.598039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5068b82-8b1a-4faf-96b9-d9985049dba7 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:55.635979 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:55.636565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:55.636848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:55.637122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:55.706127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:55.707608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:55.733844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:55.810997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 593/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:15:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:15:55.817981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:55.929273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63825ae-3658-47e3-b91f-4633c1372342 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:55.943711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:55.965729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a586708-cd1d-46e7-8fc0-800d5935a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:55.966626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a586708-cd1d-46e7-8fc0-800d5935a334 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:55.966906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a586708-cd1d-46e7-8fc0-800d5935a334 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:55.967176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a586708-cd1d-46e7-8fc0-800d5935a334 None admin] PATH_INFO: `/v3/projects/2f197fa40e584e3e91858b100539ce01` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:55.968704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a586708-cd1d-46e7-8fc0-800d5935a334 None admin] RBAC: Authorizing `identity:get_project(project_id=2f197fa40e584e3e91858b100539ce01)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:55.970155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a586708-cd1d-46e7-8fc0-800d5935a334 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:55.971886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 591/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:55 2022] GET /identity/v3/projects/2f197fa40e584e3e91858b100539ce01 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:55.978207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:56.079600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f905f02-0e9b-4dd2-a5b1-aa10a3391380 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:56.105274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:56.117298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ebab6-a727-48c9-ae33-4b5216135451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:56.118256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ebab6-a727-48c9-ae33-4b5216135451 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:56.118705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ebab6-a727-48c9-ae33-4b5216135451 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:56.119084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ebab6-a727-48c9-ae33-4b5216135451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:56.120388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ebab6-a727-48c9-ae33-4b5216135451 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=2f197fa40e584e3e91858b100539ce01, user.id=564d9453aab940f5ae0b22997a19c577) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:56.120821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ebab6-a727-48c9-ae33-4b5216135451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:56.123136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ebab6-a727-48c9-ae33-4b5216135451 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:56.129750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 594/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:15:55 2022] GET /identity/v3/role_assignments?user.id=564d9453aab940f5ae0b22997a19c577&scope.project.id=2f197fa40e584e3e91858b100539ce01&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:58.120155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7410abd-fecd-4e90-8f6e-76f0f78a52fb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:58.121046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7410abd-fecd-4e90-8f6e-76f0f78a52fb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:58.121046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7410abd-fecd-4e90-8f6e-76f0f78a52fb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:58.123314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 592/1186] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:15:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:15:58.129784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944b6bc-e60a-4e57-9646-e98bc1be85ba None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:58.130531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944b6bc-e60a-4e57-9646-e98bc1be85ba None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:58.130715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944b6bc-e60a-4e57-9646-e98bc1be85ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:58.152849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e944b6bc-e60a-4e57-9646-e98bc1be85ba None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:15:58.154039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e944b6bc-e60a-4e57-9646-e98bc1be85ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:15:58.252849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 595/1187] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:15:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:15:58.276441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7410abd-fecd-4e90-8f6e-76f0f78a52fb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:58.393461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7410abd-fecd-4e90-8f6e-76f0f78a52fb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:58.429715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:58.430530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:58.430809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:58.431078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:58.442573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:15:58.450056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:15:58.451183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:15:58.452679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 593/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:15:58.460244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944b6bc-e60a-4e57-9646-e98bc1be85ba None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:58.578121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944b6bc-e60a-4e57-9646-e98bc1be85ba None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:58.599335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:58.614395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:58.615419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:58.615697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:58.615967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:58.616722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:15:58.617037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:58.618440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:58.627044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 596/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:58.633604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:58.686115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:58.748374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c96ba-9cad-4014-893a-336f8912d67e None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:58.783613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:58.784470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:58.784746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:58.785014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] PATH_INFO: `/v3/users/564d9453aab940f5ae0b22997a19c577` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:58.786242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] RBAC: Authorizing `identity:get_user(user_id=564d9453aab940f5ae0b22997a19c577)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:58.787718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:58.789336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 594/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:15:58 2022] GET /identity/v3/users/564d9453aab940f5ae0b22997a19c577 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:58.795509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:58.908697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e1ec8-00f8-42f7-b272-73a3cb8b5c9f None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:58.948617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d4a39-12ce-4754-9724-0eeea3742943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:58.949435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d4a39-12ce-4754-9724-0eeea3742943 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:58.949720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d4a39-12ce-4754-9724-0eeea3742943 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:58.949990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d4a39-12ce-4754-9724-0eeea3742943 None admin] PATH_INFO: `/v3/projects/2f197fa40e584e3e91858b100539ce01` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:58.951260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d4a39-12ce-4754-9724-0eeea3742943 None admin] RBAC: Authorizing `identity:get_project(project_id=2f197fa40e584e3e91858b100539ce01)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:58.952940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d4a39-12ce-4754-9724-0eeea3742943 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:58.954711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 597/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:15:58 2022] GET /identity/v3/projects/2f197fa40e584e3e91858b100539ce01 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:15:58.960963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:15:59.071401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab7d31-ccee-42d1-a30b-b9444eee6e85 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:15:59.082541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:15:59.109603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfc6f1-0c05-4400-8ed2-e75227444211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:15:59.110514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfc6f1-0c05-4400-8ed2-e75227444211 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:15:59.110795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfc6f1-0c05-4400-8ed2-e75227444211 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:15:59.111035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfc6f1-0c05-4400-8ed2-e75227444211 None admin] PATH_INFO: `/v3/projects/2f197fa40e584e3e91858b100539ce01/users/564d9453aab940f5ae0b22997a19c577/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:15:59.113130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfc6f1-0c05-4400-8ed2-e75227444211 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f197fa40e584e3e91858b100539ce01, user_id=564d9453aab940f5ae0b22997a19c577, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:15:59.114947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfc6f1-0c05-4400-8ed2-e75227444211 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:15:59.129739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 595/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:15:58 2022] PUT /identity/v3/projects/2f197fa40e584e3e91858b100539ce01/users/564d9453aab940f5ae0b22997a19c577/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:16:01.108420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e86f6-16b0-453c-8784-51635f293f17 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:01.109245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e86f6-16b0-453c-8784-51635f293f17 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:01.109245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e86f6-16b0-453c-8784-51635f293f17 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:01.111601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 598/1193] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:16:01.120054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a019aa2-a4c7-40c3-aa5b-9916b9d76f1e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:01.120507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a019aa2-a4c7-40c3-aa5b-9916b9d76f1e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:01.120601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a019aa2-a4c7-40c3-aa5b-9916b9d76f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:01.139538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0a019aa2-a4c7-40c3-aa5b-9916b9d76f1e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:16:01.140800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a019aa2-a4c7-40c3-aa5b-9916b9d76f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:16:01.213721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 596/1194] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:16:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:16:01.237863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e86f6-16b0-453c-8784-51635f293f17 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:01.291676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:01.343391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e86f6-16b0-453c-8784-51635f293f17 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:01.379425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:01.380479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:01.380836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:01.381242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:01.400219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:16:01.409981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:16:01.410956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:16:01.411792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 599/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:16:01.418155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a019aa2-a4c7-40c3-aa5b-9916b9d76f1e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:01.528201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:01.532256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a019aa2-a4c7-40c3-aa5b-9916b9d76f1e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:01.592394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:01.593191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:01.593630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:01.593902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:01.594705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:16:01.595013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:01.596438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:01.605308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 597/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:16:01.611549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:01.718496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff5450-0cec-44aa-9308-2a6f50e4fec9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:01.729133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:01.757347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:01.758222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:01.758532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:01.758809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] PATH_INFO: `/v3/users/564d9453aab940f5ae0b22997a19c577` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:01.760010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] RBAC: Authorizing `identity:get_user(user_id=564d9453aab940f5ae0b22997a19c577)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:01.761458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:01.763169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 600/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Tue Jul 12 17:16:01 2022] GET /identity/v3/users/564d9453aab940f5ae0b22997a19c577 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:16:01.771695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:01.880349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586db898-84a6-451f-a05a-bddcc9ba63e7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:01.918674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:01.919339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:01.919618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:01.919893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:01.964135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:02.007820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:02.009213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:02.111851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 598/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:16:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:16:02.119046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:02.225803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604fb0c-a1f8-417d-8abe-4449a05ac025 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:02.262397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc179-ad21-4c0b-9b7b-e13cbca5c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:02.263214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc179-ad21-4c0b-9b7b-e13cbca5c573 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:02.263501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc179-ad21-4c0b-9b7b-e13cbca5c573 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:02.263775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc179-ad21-4c0b-9b7b-e13cbca5c573 None admin] PATH_INFO: `/v3/projects/2f197fa40e584e3e91858b100539ce01` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:02.265362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc179-ad21-4c0b-9b7b-e13cbca5c573 None admin] RBAC: Authorizing `identity:get_project(project_id=2f197fa40e584e3e91858b100539ce01)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:02.266837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc179-ad21-4c0b-9b7b-e13cbca5c573 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:02.268538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 601/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Tue Jul 12 17:16:02 2022] GET /identity/v3/projects/2f197fa40e584e3e91858b100539ce01 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:16:02.275457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:02.342753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:02.386018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7324d51-16fe-4d07-9dd7-453ada64ace2 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:02.421185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720bc5c-936d-4253-a998-54992ef38520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:02.421864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bc5c-936d-4253-a998-54992ef38520 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:02.422143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bc5c-936d-4253-a998-54992ef38520 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:02.422439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720bc5c-936d-4253-a998-54992ef38520 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:02.423270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720bc5c-936d-4253-a998-54992ef38520 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=2f197fa40e584e3e91858b100539ce01, user.id=564d9453aab940f5ae0b22997a19c577) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:16:02.423580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720bc5c-936d-4253-a998-54992ef38520 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:02.425022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720bc5c-936d-4253-a998-54992ef38520 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:02.431049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 599/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:16:02 2022] GET /identity/v3/role_assignments?user.id=564d9453aab940f5ae0b22997a19c577&scope.project.id=2f197fa40e584e3e91858b100539ce01&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:16:12.257108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=77 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:12.428434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=37 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:58.035076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f725e3-96b3-4053-9dfa-cf2cd41f1609 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:58.035637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f725e3-96b3-4053-9dfa-cf2cd41f1609 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:58.035637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f725e3-96b3-4053-9dfa-cf2cd41f1609 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:58.037255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 602/1201] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:16:58.042486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393dcd-f8b3-409f-982d-46cacd84e973 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:58.042961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393dcd-f8b3-409f-982d-46cacd84e973 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:58.043046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393dcd-f8b3-409f-982d-46cacd84e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:58.061527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-66393dcd-f8b3-409f-982d-46cacd84e973 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:16:58.061950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-66393dcd-f8b3-409f-982d-46cacd84e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:16:58.154710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 600/1202] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:16:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:16:58.181170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f725e3-96b3-4053-9dfa-cf2cd41f1609 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:58.317972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f725e3-96b3-4053-9dfa-cf2cd41f1609 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:58.361548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:58.362510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:58.362919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:58.363197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:58.377031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:58.378651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:16:58.400073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:16:58.401114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:16:58.402083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:16:58.402083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:16:58.402083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:16:58.402083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:16:58.402083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 603/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:16:58.409875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393dcd-f8b3-409f-982d-46cacd84e973 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:58.536663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393dcd-f8b3-409f-982d-46cacd84e973 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:58.576105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:58.584567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150024e-35da-4c96-83cf-cd530de08a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:58.585564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150024e-35da-4c96-83cf-cd530de08a3a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:58.586187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150024e-35da-4c96-83cf-cd530de08a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:58.586504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150024e-35da-4c96-83cf-cd530de08a3a None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:58.587261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150024e-35da-4c96-83cf-cd530de08a3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:16:58.587573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150024e-35da-4c96-83cf-cd530de08a3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:58.588953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150024e-35da-4c96-83cf-cd530de08a3a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:58.601736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 601/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:16:58.607391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:16:58.671371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:16:58.729547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0816d-06ad-4fc7-8c6f-db5cca82e58d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:16:58.777797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c10a12-b01a-4db5-97b1-96b13f3748e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:16:58.778639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c10a12-b01a-4db5-97b1-96b13f3748e7 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:16:58.778924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c10a12-b01a-4db5-97b1-96b13f3748e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:16:58.779272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c10a12-b01a-4db5-97b1-96b13f3748e7 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:16:58.780151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c10a12-b01a-4db5-97b1-96b13f3748e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:16:58.781865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c10a12-b01a-4db5-97b1-96b13f3748e7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:16:58.818349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 604/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Tue Jul 12 17:16:58 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:17:01.059334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dad6a-b904-4032-89f7-dcaf3e018db8 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:01.059908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dad6a-b904-4032-89f7-dcaf3e018db8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:01.059908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dad6a-b904-4032-89f7-dcaf3e018db8 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:01.061254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 602/1206] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:01.067603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fda0-57d2-4468-b207-3abd79951be8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:01.068168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fda0-57d2-4468-b207-3abd79951be8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:01.068168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5fda0-57d2-4468-b207-3abd79951be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:01.086970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5de5fda0-57d2-4468-b207-3abd79951be8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:01.088340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5de5fda0-57d2-4468-b207-3abd79951be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:01.168691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 605/1207] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:01.193793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dad6a-b904-4032-89f7-dcaf3e018db8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:01.311726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dad6a-b904-4032-89f7-dcaf3e018db8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:01.358842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:01.359599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:01.359859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:01.360311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:01.373338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:17:01.383567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:01.385372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:01.386583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 603/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:01.391189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fda0-57d2-4468-b207-3abd79951be8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:01.436849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:01.505831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5fda0-57d2-4468-b207-3abd79951be8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:01.551343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:01.552165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:01.552543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:01.552906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:01.553773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:01.554193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:01.555658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:01.569601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 606/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:17:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:01.571292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:01.636381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:01.696320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75dcf7-d790-422a-bc56-39b17d708410 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:01.740309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:01.743219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:01.743219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:01.743219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:01.755213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:01.756769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:01.776079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:01.777157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:01.778088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:01.778088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:01.778088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:01.778088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:01.778088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 604/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:01.783510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:01.898693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:01.902052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b993018-0379-4f3c-86b4-ce8b371c2a4c None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:01.951010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:01.951645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:01.951920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:01.952193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:01.952919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:01.953219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:01.955635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:01.974323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 607/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:01.978022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:02.098171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171af2b-0b37-4bbc-980b-4df61c6f4ddf None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:02.098841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:02.136984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:02.138431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:02.139359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:02.139359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:02.149529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:02.150629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:17:02.169995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:02.171277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:02.172304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 605/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:02.177507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:02.309691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da31c01-40f7-4124-bb18-7600b61599bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:02.356960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:02.358099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:02.358611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:02.359176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:02.361097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:02.361298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:02.363075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:02.385159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 608/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Jul 12 17:17:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:02.391087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:02.513578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e48eb-82a7-4568-8b0b-9c39dd1d5226 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:02.556630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:02.557267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:02.557728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:02.558624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:02.601859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:02.654074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:02.656485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:02.778599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 606/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:17:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:17:02.785175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:02.808509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:02.910763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df698e73-2146-4f9c-aec2-495876049eb6 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:02.949108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:02.950026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:02.950319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:02.950587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:02.963163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:02.964623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:02.984163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:02.985370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:02.986428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:02.986428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:02.986428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:02.986428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:02.986428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 609/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:17:02.992262 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:03.066590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:03.110265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10b48e-aba3-4ee6-ae78-31894a15f5b7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:03.150900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:03.151591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:03.152046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:03.152169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:03.152959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:03.153274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:03.154769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:03.168412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 607/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:03.174468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:03.262166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:03.299722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472475d-bc3e-4684-85ac-78257c52ea67 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:03.338831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:03.339565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:03.339849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:03.340124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:03.350186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:03.351700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:17:03.368723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:03.370576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:03.371570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 610/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:03.379368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:03.492054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7725405-0c6a-4b29-a7bd-6e1bb048ad46 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:03.521299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:03.536284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f265111-5428-41d2-9be8-4b33c3250a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:03.537163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f265111-5428-41d2-9be8-4b33c3250a9d None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:03.537549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f265111-5428-41d2-9be8-4b33c3250a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:03.538002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f265111-5428-41d2-9be8-4b33c3250a9d None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:03.538881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f265111-5428-41d2-9be8-4b33c3250a9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:03.539219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f265111-5428-41d2-9be8-4b33c3250a9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:03.540759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f265111-5428-41d2-9be8-4b33c3250a9d None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:03.556206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 608/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:03.562108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:03.678242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318bbe1-bfb6-416d-9159-9035665ec4b8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:03.712636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:03.719591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a17889e-c2ef-4db3-9d2c-faed0e4e99a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:03.721162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17889e-c2ef-4db3-9d2c-faed0e4e99a5 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:03.721644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17889e-c2ef-4db3-9d2c-faed0e4e99a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:03.722197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a17889e-c2ef-4db3-9d2c-faed0e4e99a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:03.723371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17889e-c2ef-4db3-9d2c-faed0e4e99a5 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=76f25ce386864d6f9090154cb210807a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:03.723741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17889e-c2ef-4db3-9d2c-faed0e4e99a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:03.725398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a17889e-c2ef-4db3-9d2c-faed0e4e99a5 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:03.732030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 611/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:17:03 2022] GET /identity/v3/role_assignments?user.id=76f25ce386864d6f9090154cb210807a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:05.906127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096b06-16bd-4931-838b-adb7151a31fd None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:05.906679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096b06-16bd-4931-838b-adb7151a31fd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:05.906679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad096b06-16bd-4931-838b-adb7151a31fd None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:05.908059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 609/1220] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:05.913615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acd4b-f199-4cfc-9d4a-64fbba277b65 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:05.914207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acd4b-f199-4cfc-9d4a-64fbba277b65 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:05.914207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acd4b-f199-4cfc-9d4a-64fbba277b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:05.932777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-728acd4b-f199-4cfc-9d4a-64fbba277b65 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:05.934244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-728acd4b-f199-4cfc-9d4a-64fbba277b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:06.009476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 612/1221] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:06.034567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad096b06-16bd-4931-838b-adb7151a31fd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:06.144933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad096b06-16bd-4931-838b-adb7151a31fd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:06.182973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:06.183839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:06.184121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:06.184389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:06.198760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:17:06.208778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:06.209846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:06.210988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 610/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:06.216740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728acd4b-f199-4cfc-9d4a-64fbba277b65 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:06.327956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728acd4b-f199-4cfc-9d4a-64fbba277b65 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:06.354497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:06.368772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:06.369615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:06.369904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:06.370181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:06.371104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:06.371454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:06.372972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:06.383405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 613/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:06.389174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:06.440141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:06.503125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68346680-39e0-49ea-ac14-ff05b5ecb015 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:06.540253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:06.541042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:06.541363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:06.541633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:06.552309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:06.553762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:06.571122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:06.572196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:06.573240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:06.573240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:06.573240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:06.573240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:06.573240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 611/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:06.578194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:06.687854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08532fc4-1269-4725-a143-a6db5c04fe66 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:06.732534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:06.733140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:06.733420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:06.733695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:06.734615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:06.734922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:06.736444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:06.749884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 614/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:06.755732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:06.863120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:06.871210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06d7e7-440d-44ae-947b-207d6ff7b29b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:06.907354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:06.908584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:06.908869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:06.909184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:06.917595 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:06.919351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:17:06.934921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:06.941122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:06.942386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 612/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:06.943128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:06.990955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:07.043791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1157-2198-4ce8-b5eb-d2accf49654b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:07.077807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:07.078507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:07.078785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:07.079098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:07.079922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:07.080208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:07.081642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:07.099550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 615/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Jul 12 17:17:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:07.105475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:07.213118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85801d-8c11-4f5a-948b-ee1399c35800 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:07.249089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:07.249822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:07.250100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:07.250406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:07.261507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:07.262996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:07.280314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:07.281303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:07.282367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:07.282367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:07.282367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:07.282367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:07.282367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 613/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:07.287556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:07.404507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2e2b-f17a-4d45-a8d0-7aec93a0b0bc None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:07.406939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:07.444055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:07.444782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:07.445063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:07.445333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:07.446133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:07.446475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:07.447850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:07.460973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 616/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:07.466984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:07.477249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:07.590310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce509de-316f-41da-96f1-dd89b43c9496 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:07.631653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:07.632533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:07.632836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:07.633180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:07.641104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:07.643065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:17:07.660345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:07.661408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:07.662383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 614/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:07.668004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:07.786442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfbe6-a3c6-4f2e-b9eb-22745a85ef2b None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:07.831499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe4b8e-9bdf-44b1-b151-096d04e46de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:07.832624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4b8e-9bdf-44b1-b151-096d04e46de7 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:07.833133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4b8e-9bdf-44b1-b151-096d04e46de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:07.833596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe4b8e-9bdf-44b1-b151-096d04e46de7 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:07.835099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe4b8e-9bdf-44b1-b151-096d04e46de7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:07.835649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe4b8e-9bdf-44b1-b151-096d04e46de7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:07.838412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe4b8e-9bdf-44b1-b151-096d04e46de7 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:07.856033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 617/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:07.862967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:07.947541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:07.987239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846ec05-49d4-492b-9974-ab9c3a107781 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:08.038281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6efbb-7650-4567-990f-0158ca0d9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:08.039419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6efbb-7650-4567-990f-0158ca0d9df3 None admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:08.039743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6efbb-7650-4567-990f-0158ca0d9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:08.040059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6efbb-7650-4567-990f-0158ca0d9df3 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/76f25ce386864d6f9090154cb210807a/roles/b18a579464c34ea6b4fb3ea7940aa4f6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:08.060536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6efbb-7650-4567-990f-0158ca0d9df3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=76f25ce386864d6f9090154cb210807a, role_id=b18a579464c34ea6b4fb3ea7940aa4f6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:08.062106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6efbb-7650-4567-990f-0158ca0d9df3 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:08.076735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 615/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:17:07 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/76f25ce386864d6f9090154cb210807a/roles/b18a579464c34ea6b4fb3ea7940aa4f6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:17:10.326574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5dc7-a97e-41ee-aa02-2c679693cb75 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:10.327192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5dc7-a97e-41ee-aa02-2c679693cb75 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:10.327192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d5dc7-a97e-41ee-aa02-2c679693cb75 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:10.328568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 618/1233] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:10.334777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02053-a4f4-4fbf-b404-83c442d95e79 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:10.335213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02053-a4f4-4fbf-b404-83c442d95e79 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:10.335408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e02053-a4f4-4fbf-b404-83c442d95e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:10.357482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-93e02053-a4f4-4fbf-b404-83c442d95e79 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:10.359181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93e02053-a4f4-4fbf-b404-83c442d95e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:10.445658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 616/1234] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:10.472139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5dc7-a97e-41ee-aa02-2c679693cb75 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:10.504341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:10.598975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d5dc7-a97e-41ee-aa02-2c679693cb75 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:10.639202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:10.640084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:10.640359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:10.640633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:10.651535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:17:10.659870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:10.660847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 17:17:10.662106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:10.662944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 619/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Tue Jul 12 17:17:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:10.668474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e02053-a4f4-4fbf-b404-83c442d95e79 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:10.718987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:10.785524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e02053-a4f4-4fbf-b404-83c442d95e79 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:10.830611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:10.831304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:10.831590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:10.831866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:10.832646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:10.832950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:10.834561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:10.848475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 617/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Tue Jul 12 17:17:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:10.849611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:10.947148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:10.965956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bb79f-f2c5-4ecf-b80c-deccd95352ba None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:11.010038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:11.011043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:11.011362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:11.011664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:11.025917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:11.027935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:11.049192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:11.050212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:11.051277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:11.051277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:11.051277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:11.051277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:11.051277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 620/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:17:11.057431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:11.179787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b004-45f7-41a8-a30f-d31a09840fcb None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:11.190425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:11.218087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:11.218876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:11.219176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:11.219596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:11.220830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:11.221194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:11.223146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:11.236661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 618/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:11.243366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:11.352294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b05d-3fc3-4023-a290-6a989231874a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:11.391609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:11.392485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:11.392796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:11.393172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:11.396260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:11.403479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:11.405381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:17:11.420792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:11.421998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:11.423426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 621/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:17:11.429648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:11.547227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a93e8a-53d9-4f89-be5e-0707fd38a112 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:11.586304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:11.587023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:11.587308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:11.587584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:11.588446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:11.588760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:11.590218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:11.611459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 619/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Jul 12 17:17:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:11.618034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:11.726489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9379dff-c747-466b-97eb-6d2e5ce6da22 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:11.762676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:11.763346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:11.763637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:11.763926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:11.839436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:11.846926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:11.848401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:11.957200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 622/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:17:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:17:11.963337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:11.993769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:12.073987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827a2df-9727-48c0-b39f-6b9f73c1e8f7 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:12.109062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:12.109790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:12.110977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:12.111547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:12.122600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:12.124109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:12.141983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:12.143116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:12.144348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:12.144348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:12.144348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:12.144348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:12.144348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 620/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:12.149204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:12.255487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:12.262400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17ebc3-51ec-488d-bfad-13ceb39f5094 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:12.301248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:12.301932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:12.302249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:12.302563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:12.303329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:12.303635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:12.305117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:12.317840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 623/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:12.323571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:12.427838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:12.453853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b034a9-d854-45f9-b357-78dca0047278 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:12.496792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:12.497894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:12.498208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:12.498782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:12.507682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:12.509341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:17:12.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:12.528492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:12.530197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:12.534514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 621/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:17:12.537087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:12.651789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc3934-922e-4e6a-82ae-a66041e0d404 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:12.690907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d78ea8-161c-4199-936b-41b75857fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:12.691553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78ea8-161c-4199-936b-41b75857fae8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:12.691838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78ea8-161c-4199-936b-41b75857fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:12.692108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d78ea8-161c-4199-936b-41b75857fae8 None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:12.692897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78ea8-161c-4199-936b-41b75857fae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:12.693204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78ea8-161c-4199-936b-41b75857fae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:12.694758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d78ea8-161c-4199-936b-41b75857fae8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:12.708008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 624/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:12.714310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:12.835265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2bf7-2937-41e4-bf72-696abbeacf22 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:12.877453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b648abf-fc1c-4518-ad13-e7f17d428e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:12.878165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648abf-fc1c-4518-ad13-e7f17d428e64 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:12.878553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648abf-fc1c-4518-ad13-e7f17d428e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:12.878830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648abf-fc1c-4518-ad13-e7f17d428e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:12.879759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648abf-fc1c-4518-ad13-e7f17d428e64 None admin] RBAC: Adding query filter params (role.id=b18a579464c34ea6b4fb3ea7940aa4f6, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=76f25ce386864d6f9090154cb210807a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:12.880085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648abf-fc1c-4518-ad13-e7f17d428e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:12.881661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648abf-fc1c-4518-ad13-e7f17d428e64 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:12.888924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 622/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:17:12 2022] GET /identity/v3/role_assignments?user.id=76f25ce386864d6f9090154cb210807a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=b18a579464c34ea6b4fb3ea7940aa4f6 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:15.173572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962fdd-f987-4a0d-8686-652a33b2a113 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:15.174273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962fdd-f987-4a0d-8686-652a33b2a113 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:15.174273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f962fdd-f987-4a0d-8686-652a33b2a113 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:15.175595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 625/1247] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:15.181437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0b455-258c-45e5-b797-c1013f747a2b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:15.181872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0b455-258c-45e5-b797-c1013f747a2b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:15.182007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0b455-258c-45e5-b797-c1013f747a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:15.187402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:15.200896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-edb0b455-258c-45e5-b797-c1013f747a2b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:15.202264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-edb0b455-258c-45e5-b797-c1013f747a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:15.281772 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 623/1248] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:15.308460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f962fdd-f987-4a0d-8686-652a33b2a113 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:15.329723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:15.432359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f962fdd-f987-4a0d-8686-652a33b2a113 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:15.473060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:15.473923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:15.474205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:15.474482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:15.485665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:17:15.493779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:15.494814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:15.495678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 626/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:15.502268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0b455-258c-45e5-b797-c1013f747a2b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:15.621617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0b455-258c-45e5-b797-c1013f747a2b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:15.656668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:15.662877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:15.663598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:15.663913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:15.664218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:15.665096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:15.665438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:15.667020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:15.681621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 624/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:15.683047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:15.773920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:15.800747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba8f4-e9cf-4679-8c1c-5d78387e5559 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:15.835943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:15.836975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:15.837291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:15.837724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:15.852113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:15.853942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:15.875044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:15.876371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:15.877565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:15.877565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:15.877565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:15.877565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:15.882602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 627/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:15.883726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:15.993279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5211902-4824-467f-ac87-611f7b540f35 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:16.027926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:16.028590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:16.028895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:16.029203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:16.029939 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:16.030247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:16.031641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:16.045080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 625/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:16.052232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:16.164026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129a36d-9ba3-46dd-ad9d-775b1e0eabe9 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:16.193305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:16.202371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:16.203413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:16.203762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:16.204240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:16.214162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:16.215791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:17:16.231546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:16.232795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:16.233988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 628/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 17:17:16.240129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:16.301331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:16.350976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd6da5-ca91-4615-aed2-69ed6a67cb19 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:16.391640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:16.392545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:16.392946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:16.393176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:16.394127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:16.394604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:16.396410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:16.422330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 626/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Jul 12 17:17:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:16.424747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:16.535911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26a58b-2fc9-470a-93d7-cdc8171454d3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:16.576138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:16.576862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:16.577213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:16.578665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:16.637157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:16.649888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:16.651371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:16.758375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 629/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:17:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:17:16.764835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:16.872351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bf33-f76f-479a-91e6-f347d69b785f None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:16.887681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:16.911509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:16.912500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:16.912783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:16.913052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:16.924926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:16.926594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:16.947295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:16.948433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:16.949785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:16.949785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:16.949785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:16.949785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:16.949785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 627/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:16.955844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:17.055630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:17.069644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b3879-1bf5-42cd-91e5-d48d35150966 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:17.106928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:17.107606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:17.107889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:17.108164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:17.108897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:17.109205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:17.112162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:17.128759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 630/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:17.131908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:17.242394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5feb33-d252-4d70-bee5-69c021f450f4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:17.281548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:17.283156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:17.283439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:17.283712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:17.291043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:17.292563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:17:17.307402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:17.308593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:17.310161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 628/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:17.315304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:17.423169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac8dad-9363-4b42-9308-ab1796869956 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:17.459850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7589c3-de1e-4e77-abbf-969900e6ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:17.460510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7589c3-de1e-4e77-abbf-969900e6ba7b None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:17.460790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7589c3-de1e-4e77-abbf-969900e6ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:17.461061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7589c3-de1e-4e77-abbf-969900e6ba7b None admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:17.461845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7589c3-de1e-4e77-abbf-969900e6ba7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:17.462148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7589c3-de1e-4e77-abbf-969900e6ba7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:17.463615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7589c3-de1e-4e77-abbf-969900e6ba7b None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:17.476013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 631/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:17.482065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:17.509313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:17.585968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35008b-9fab-4252-9a45-b22437c8bf9b None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:17.621551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64d9a4-abbb-44fd-ad58-dd6a16286c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:17.622224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d9a4-abbb-44fd-ad58-dd6a16286c48 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:17.622542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d9a4-abbb-44fd-ad58-dd6a16286c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:17.622833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d9a4-abbb-44fd-ad58-dd6a16286c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:17.623733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d9a4-abbb-44fd-ad58-dd6a16286c48 None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=76f25ce386864d6f9090154cb210807a) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:17.624061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d9a4-abbb-44fd-ad58-dd6a16286c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:17.625546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d9a4-abbb-44fd-ad58-dd6a16286c48 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:17.634858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 629/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:17:17 2022] GET /identity/v3/role_assignments?user.id=76f25ce386864d6f9090154cb210807a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:19.619666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f139d-a538-46b2-b93b-c8709cb0634f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:19.620180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f139d-a538-46b2-b93b-c8709cb0634f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:19.620180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f139d-a538-46b2-b93b-c8709cb0634f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:19.621606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 632/1261] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:19.627088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb020-22a7-4a82-aa0c-8418ba743dd0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:19.627528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb020-22a7-4a82-aa0c-8418ba743dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:19.627634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdb020-22a7-4a82-aa0c-8418ba743dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:19.646215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-34fdb020-22a7-4a82-aa0c-8418ba743dd0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:19.647413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-34fdb020-22a7-4a82-aa0c-8418ba743dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:19.716541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 630/1262] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:19.739530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f139d-a538-46b2-b93b-c8709cb0634f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:19.752985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:19.849174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f139d-a538-46b2-b93b-c8709cb0634f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:19.883885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:19.884670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:19.884946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:19.885215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:19.895667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:17:19.903224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:19.904225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:19.905098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 633/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:17:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:19.910800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb020-22a7-4a82-aa0c-8418ba743dd0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:19.932208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:20.023083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdb020-22a7-4a82-aa0c-8418ba743dd0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:20.063968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:20.064678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:20.064963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:20.065239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:20.065991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:20.066334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:20.067725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:20.076033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 631/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:17:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:20.082570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:20.156327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:20.191628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af6126-b84d-4ffb-8fc2-18df1408e4d2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:20.227278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:20.228075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:20.228363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:20.228636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:20.240517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:20.241967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:20.259820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:20.260843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:20.261957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:20.261957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:20.261957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:20.261957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:20.261957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 634/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:20.267862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:20.373286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:20.395115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977eac6-2d9f-4475-b49d-447c6822ddf8 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:20.434400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:20.434990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:20.435267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:20.435533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:20.436249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:20.436551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:20.437925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:20.450481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 632/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:20.456641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:20.561828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689e9ce-bcd0-466a-bada-112b367d240a None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:20.583786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:20.599645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:20.600453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:20.600719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:20.600984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:20.609412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:20.611042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:17:20.625327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:20.626896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:20.628008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 635/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:20.632607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:20.753571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af28cd-4689-4d24-9030-51cb60d60747 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:20.800544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:20.801493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:20.801866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:20.802227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:20.803547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:20.803980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:20.806202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:20.817790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:20.826875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 633/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Jul 12 17:17:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:20.832976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:20.935833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793aed2-c314-4fff-9239-5697ba6346a2 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:20.969594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:20.970405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:20.970690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:20.970956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:20.982094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:20.983585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:21.002738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:21.003808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:21.005879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:21.005879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:21.005879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:21.005879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:21.005879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 636/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:21.012648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:21.125565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb317801-24f1-4152-9634-77cd9007de15 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:21.165948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:21.166669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:21.166953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:21.167228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:21.167954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:21.168259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:21.169666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:21.181459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 634/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:21.189892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:21.224248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:21.302385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9f3ed-1b23-470c-97f6-d767d7dc6e70 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:21.344665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:21.345873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:21.346213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:21.346578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:21.355441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:21.357175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:17:21.376203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:21.377256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:21.378249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 637/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:21.384565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:21.459021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:21.505194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea59ecb-f13f-437b-ad5f-034d3f39de46 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:21.542971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f768165-9770-4166-8462-2d18ec700670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:21.543620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f768165-9770-4166-8462-2d18ec700670 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:21.543893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f768165-9770-4166-8462-2d18ec700670 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:21.544159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f768165-9770-4166-8462-2d18ec700670 None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:21.544937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f768165-9770-4166-8462-2d18ec700670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:21.545243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f768165-9770-4166-8462-2d18ec700670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:21.546713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f768165-9770-4166-8462-2d18ec700670 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:21.558951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 635/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:21.566961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:21.665993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:21.676602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bfc1c-5f15-4cf8-849a-03236d8c6f5d None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:21.713468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20dbea-0d88-428b-a8f3-d2574e21aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:21.714428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20dbea-0d88-428b-a8f3-d2574e21aa43 None admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:21.714711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20dbea-0d88-428b-a8f3-d2574e21aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:21.714981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20dbea-0d88-428b-a8f3-d2574e21aa43 None admin] PATH_INFO: `/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/76f25ce386864d6f9090154cb210807a/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:21.717019 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20dbea-0d88-428b-a8f3-d2574e21aa43 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2dd148c72e44c6ada9496cd6fda081, user_id=76f25ce386864d6f9090154cb210807a, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:21.718487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20dbea-0d88-428b-a8f3-d2574e21aa43 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:21.732973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 638/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Tue Jul 12 17:17:21 2022] PUT /identity/v3/projects/9a2dd148c72e44c6ada9496cd6fda081/users/76f25ce386864d6f9090154cb210807a/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:17:23.717388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463b310-73c5-4613-861a-3f336233155c None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:23.718405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463b310-73c5-4613-861a-3f336233155c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:23.718405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463b310-73c5-4613-861a-3f336233155c None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:23.720684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 636/1274] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:23.727039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907b68-05f1-448c-b935-3df143a45074 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:23.727767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907b68-05f1-448c-b935-3df143a45074 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:23.727934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907b68-05f1-448c-b935-3df143a45074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:23.754636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b9907b68-05f1-448c-b935-3df143a45074 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:23.755812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b9907b68-05f1-448c-b935-3df143a45074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:23.826275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 639/1275] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:23.850618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463b310-73c5-4613-861a-3f336233155c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:23.961200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463b310-73c5-4613-861a-3f336233155c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:23.978552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:23.995720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:23.996513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:23.996788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:23.997082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:24.007231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 17:17:24.014906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:24.015932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:24.017110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 637/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Tue Jul 12 17:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:24.022386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907b68-05f1-448c-b935-3df143a45074 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:24.109482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:24.129655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907b68-05f1-448c-b935-3df143a45074 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:24.165484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:24.166141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:24.166440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:24.166715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:24.167460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:24.167766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:24.169138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:24.177435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 640/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Tue Jul 12 17:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:24.183286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:24.286459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d16912-ed67-477f-a9d4-f2f90ad1eb8a None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:24.320790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:24.321577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:24.321849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:24.322097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:24.333448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:24.334984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:24.355445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:24.356618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:24.357909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:24.357909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:24.357909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:24.357909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:24.357909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 638/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:24.364022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:24.475490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484c2f4-88b4-41bc-b4bf-d9f247c077d8 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:24.513620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:24.514273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:24.514586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:24.514887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:24.515632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:24.515935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:24.517356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:24.529713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 641/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:24.539340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:24.579829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:24.651445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55978f3-76ac-4b41-a4f4-fd5bfb425bdd None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:24.695833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:24.696997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:24.697341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:24.697696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:24.707487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:24.708936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 17:17:24.723225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:24.724841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:24.726131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 639/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:24.730421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:24.734499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:24.834886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837d6d3-9e8d-436f-a6a5-4db775547dea None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:24.869673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:24.870332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:24.870634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:24.870900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:24.871725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:24.872028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:24.873457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:24.890469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 642/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Tue Jul 12 17:17:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:24.896588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:24.997444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:25.008233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c57ff-33eb-43af-9a4a-0d6ad7435271 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:25.048370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:25.049026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:25.049305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:25.049577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:25.124925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:25.127109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:25.219797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:25.231253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 640/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Tue Jul 12 17:17:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 17:17:25.238571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:25.310710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:25.356833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df0ded-6da5-4bd5-977f-6d139c331578 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:25.393563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:25.394356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:25.394661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:25.394929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:25.405552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:25.407034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 17:17:25.426017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:25.427071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:25.428068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 17:17:25.428068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 17:17:25.428068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 17:17:25.428068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:25.428068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 643/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:25.435902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:25.547035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1e73d-cdd5-4cfc-b0dc-da76fcff69a4 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:25.585094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:25.585689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:25.585971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:25.586243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:25.587000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:25.587310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:25.588686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:25.601239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 641/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Tue Jul 12 17:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:25.607681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:25.717959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0e477-becf-4fb4-9e50-d74a4c259e90 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:25.732599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:25.755946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:25.756740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:25.757023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:25.757299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:25.764330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:25.765782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 17:17:25.780297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:25.781338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: ERROR keystone.server.flask.application Jul 12 17:17:25.782588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 644/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Tue Jul 12 17:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:25.787978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:25.841408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:25.891981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2813-6df1-4b80-9f1d-4799ea137862 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:25.928612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d86f06-9e4f-4d8a-b14a-e5daba6bf50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:25.929264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d86f06-9e4f-4d8a-b14a-e5daba6bf50a None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:25.929541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d86f06-9e4f-4d8a-b14a-e5daba6bf50a None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:25.929805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d86f06-9e4f-4d8a-b14a-e5daba6bf50a None admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:25.930616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d86f06-9e4f-4d8a-b14a-e5daba6bf50a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:25.930920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d86f06-9e4f-4d8a-b14a-e5daba6bf50a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:25.932349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d86f06-9e4f-4d8a-b14a-e5daba6bf50a None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:25.944581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 642/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Tue Jul 12 17:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:25.954332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:26.071253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef175ad-480c-4572-a480-196fc723b130 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:26.106206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971702d-8c18-43b4-8ff7-7c4143f7924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:26.106811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971702d-8c18-43b4-8ff7-7c4143f7924f None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:26.107087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971702d-8c18-43b4-8ff7-7c4143f7924f None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:26.107354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971702d-8c18-43b4-8ff7-7c4143f7924f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:26.108168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971702d-8c18-43b4-8ff7-7c4143f7924f None admin] RBAC: Adding query filter params (role.id=9cb432924fc7410bbed794ed0a33b85c, scope.project.id=9a2dd148c72e44c6ada9496cd6fda081, user.id=76f25ce386864d6f9090154cb210807a) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:26.108475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971702d-8c18-43b4-8ff7-7c4143f7924f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:26.109901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971702d-8c18-43b4-8ff7-7c4143f7924f None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:26.116227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 645/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Tue Jul 12 17:17:25 2022] GET /identity/v3/role_assignments?user.id=76f25ce386864d6f9090154cb210807a&scope.project.id=9a2dd148c72e44c6ada9496cd6fda081&role.id=9cb432924fc7410bbed794ed0a33b85c => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:28.183557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d195d-21bc-4384-9ea0-ad41aa98051f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:28.184464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d195d-21bc-4384-9ea0-ad41aa98051f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:28.184464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d195d-21bc-4384-9ea0-ad41aa98051f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:28.186653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 643/1288] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:28.192900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da363-8f79-45b7-9e09-e569174c257e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:28.193355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da363-8f79-45b7-9e09-e569174c257e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:28.193446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41da363-8f79-45b7-9e09-e569174c257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:28.211448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b41da363-8f79-45b7-9e09-e569174c257e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:28.212624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b41da363-8f79-45b7-9e09-e569174c257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:28.244639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:28.287438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 646/1289] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 17:17:28.320216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d195d-21bc-4384-9ea0-ad41aa98051f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:28.442729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d195d-21bc-4384-9ea0-ad41aa98051f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:28.453460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:28.480197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:28.481038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:28.481321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:28.481594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:28.482247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:28.483663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:28.496708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:28.497972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:28.499299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 644/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:17:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:28.504647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41da363-8f79-45b7-9e09-e569174c257e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:28.618453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41da363-8f79-45b7-9e09-e569174c257e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:28.654326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426abd5-d937-4b3c-a80e-a0eea352a6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:28.655014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426abd5-d937-4b3c-a80e-a0eea352a6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:28.655297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426abd5-d937-4b3c-a80e-a0eea352a6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:28.655575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426abd5-d937-4b3c-a80e-a0eea352a6c6 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:28.656292 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426abd5-d937-4b3c-a80e-a0eea352a6c6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:28.656598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426abd5-d937-4b3c-a80e-a0eea352a6c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:28.658013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426abd5-d937-4b3c-a80e-a0eea352a6c6 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:28.663013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 647/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Jul 12 17:17:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:28.669905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:28.780609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff61a0-e472-40ff-9bff-7ae105b6d355 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:28.819755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bc7a3-ee52-40b1-9a9a-9d08b1079866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:28.820422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bc7a3-ee52-40b1-9a9a-9d08b1079866 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:28.820699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bc7a3-ee52-40b1-9a9a-9d08b1079866 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:28.820975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bc7a3-ee52-40b1-9a9a-9d08b1079866 None admin] PATH_INFO: `/v3/services` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:28.821689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bc7a3-ee52-40b1-9a9a-9d08b1079866 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:28.821993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bc7a3-ee52-40b1-9a9a-9d08b1079866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:28.823419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76bc7a3-ee52-40b1-9a9a-9d08b1079866 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:28.828328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 645/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Jul 12 17:17:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:30.798478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba727a-aa51-492c-9d42-1d349a659238 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:30.799413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba727a-aa51-492c-9d42-1d349a659238 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:30.799413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba727a-aa51-492c-9d42-1d349a659238 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:30.801484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 648/1293] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:30.810178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05302-0176-4b9b-85e0-588b5cf007a3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:30.810944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05302-0176-4b9b-85e0-588b5cf007a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:30.811111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e05302-0176-4b9b-85e0-588b5cf007a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:30.835824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11e05302-0176-4b9b-85e0-588b5cf007a3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:30.837015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11e05302-0176-4b9b-85e0-588b5cf007a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:30.872406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:30.918091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 646/1294] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:30.940526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba727a-aa51-492c-9d42-1d349a659238 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:30.976361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:31.046597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba727a-aa51-492c-9d42-1d349a659238 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:31.083973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27dbb2-0a27-4d77-bf8a-35eb25a6db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:31.084635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27dbb2-0a27-4d77-bf8a-35eb25a6db03 None admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:31.084915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27dbb2-0a27-4d77-bf8a-35eb25a6db03 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:31.085188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27dbb2-0a27-4d77-bf8a-35eb25a6db03 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:31.085915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27dbb2-0a27-4d77-bf8a-35eb25a6db03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:31.087308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27dbb2-0a27-4d77-bf8a-35eb25a6db03 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:31.104067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 649/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Tue Jul 12 17:17:30 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:17:33.206537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb744-5aaa-4367-a0e3-c5fa835ec668 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:33.207132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb744-5aaa-4367-a0e3-c5fa835ec668 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:33.207132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065eb744-5aaa-4367-a0e3-c5fa835ec668 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:33.208490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 647/1296] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:33.214958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01037c23-2849-4bdf-b362-60e1e82e7214 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:33.216204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01037c23-2849-4bdf-b362-60e1e82e7214 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:33.216664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01037c23-2849-4bdf-b362-60e1e82e7214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:33.235361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-01037c23-2849-4bdf-b362-60e1e82e7214 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:33.236543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-01037c23-2849-4bdf-b362-60e1e82e7214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:33.316463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 650/1297] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:33.351801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb744-5aaa-4367-a0e3-c5fa835ec668 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:33.474197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065eb744-5aaa-4367-a0e3-c5fa835ec668 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:33.509268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:33.510063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:33.510373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:33.510648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:33.511297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:33.512691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:33.525686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:33.526866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:33.527962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 648/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:17:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:33.533989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01037c23-2849-4bdf-b362-60e1e82e7214 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:33.562937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:33.657502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01037c23-2849-4bdf-b362-60e1e82e7214 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:33.693739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:33.694420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:33.694699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:33.694965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:33.695672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:33.695973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:33.697352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:33.702624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 651/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Jul 12 17:17:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:17:33.709281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:33.742486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:33.812824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c30edf-a431-4609-ab75-3776bd2726bc None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:33.847050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04020da-6ca2-4664-a01b-49c2b20f0dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:33.847719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04020da-6ca2-4664-a01b-49c2b20f0dbe None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:33.847996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04020da-6ca2-4664-a01b-49c2b20f0dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:33.848263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04020da-6ca2-4664-a01b-49c2b20f0dbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:33.849047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04020da-6ca2-4664-a01b-49c2b20f0dbe None admin] RBAC: Adding query filter params (interface=public, service_id=ca1500172ccb451197ccfa9a02ea67bc, region_id=RegionOne) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:33.849356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04020da-6ca2-4664-a01b-49c2b20f0dbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:33.850748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04020da-6ca2-4664-a01b-49c2b20f0dbe None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:33.855944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 649/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Tue Jul 12 17:17:33 2022] GET /identity/v3/endpoints?service_id=ca1500172ccb451197ccfa9a02ea67bc&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:33.861870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:33.950083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:33.972209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3946df5-f1c9-44f5-a3df-835603c1d1d3 None admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:34.008930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ae7ff-dfcb-4a28-a6b6-fc300479eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:34.009523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ae7ff-dfcb-4a28-a6b6-fc300479eed3 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:34.009808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ae7ff-dfcb-4a28-a6b6-fc300479eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:34.010081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ae7ff-dfcb-4a28-a6b6-fc300479eed3 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:34.010804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ae7ff-dfcb-4a28-a6b6-fc300479eed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:34.012189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ae7ff-dfcb-4a28-a6b6-fc300479eed3 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:34.019382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 652/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Tue Jul 12 17:17:33 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:17:36.077208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8e96b-2fd9-43f3-a024-a1a617f9d5a6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:36.078041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8e96b-2fd9-43f3-a024-a1a617f9d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:36.078041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8e96b-2fd9-43f3-a024-a1a617f9d5a6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:36.080071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 650/1302] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:17:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:17:36.086952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ca814-aaf4-4747-83f6-09e50cc3d8de None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:36.087616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ca814-aaf4-4747-83f6-09e50cc3d8de None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:36.087804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ca814-aaf4-4747-83f6-09e50cc3d8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:36.112528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-977ca814-aaf4-4747-83f6-09e50cc3d8de None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:17:36.114087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-977ca814-aaf4-4747-83f6-09e50cc3d8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:17:36.191151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 653/1303] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:17:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 17:17:36.215062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8e96b-2fd9-43f3-a024-a1a617f9d5a6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:36.335274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:36.344808 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8e96b-2fd9-43f3-a024-a1a617f9d5a6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:36.399655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:36.400467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:36.400748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:36.401029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:36.401692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:36.403116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 17:17:36.416980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 17:17:36.418233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application with Lock( Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self._enter() Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application return self.creator() Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application created_value = creator( Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: ERROR keystone.server.flask.application Jul 12 17:17:36.419521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 651/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Tue Jul 12 17:17:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 17:17:36.426317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ca814-aaf4-4747-83f6-09e50cc3d8de None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:36.514322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:36.539572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ca814-aaf4-4747-83f6-09e50cc3d8de None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:36.577078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2283b-da1d-45d7-b2c1-74fd794b7138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:36.577747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2283b-da1d-45d7-b2c1-74fd794b7138 None admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:36.578027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2283b-da1d-45d7-b2c1-74fd794b7138 None admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:36.578314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2283b-da1d-45d7-b2c1-74fd794b7138 None admin] PATH_INFO: `/v3/services` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:36.579039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2283b-da1d-45d7-b2c1-74fd794b7138 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:17:36.579330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2283b-da1d-45d7-b2c1-74fd794b7138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:36.580837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2283b-da1d-45d7-b2c1-74fd794b7138 None admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:36.587523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 654/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Tue Jul 12 17:17:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:17:36.594208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:17:36.724353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b0bba0-dffb-44f7-93e7-3a281270e173 None admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:17:36.763555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8109595-8237-4c26-9a37-f7e313929741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:17:36.764605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8109595-8237-4c26-9a37-f7e313929741 None admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:17:36.765079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8109595-8237-4c26-9a37-f7e313929741 None admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:17:36.765540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8109595-8237-4c26-9a37-f7e313929741 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:17:36.766832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8109595-8237-4c26-9a37-f7e313929741 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:17:36.769103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8109595-8237-4c26-9a37-f7e313929741 None admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:17:36.793709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 652/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Tue Jul 12 17:17:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:17:46.583917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=30 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:17:46.788688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:39.999623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672fb4c-bd31-4fcf-ad23-7a7cc8a5a895 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:40.000193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672fb4c-bd31-4fcf-ad23-7a7cc8a5a895 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:40.000193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672fb4c-bd31-4fcf-ad23-7a7cc8a5a895 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:40.005359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 655/1307] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:18:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:40.006992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1eec-9a23-4eb9-884d-f99aa10b5f30 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:40.007817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1eec-9a23-4eb9-884d-f99aa10b5f30 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:40.008235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1eec-9a23-4eb9-884d-f99aa10b5f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:40.097945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b6bc1eec-9a23-4eb9-884d-f99aa10b5f30 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:40.099180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b6bc1eec-9a23-4eb9-884d-f99aa10b5f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:40.203333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 653/1308] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:40.257439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6b23-0567-4337-8bbb-727ac3fef6a2 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:40.257902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6b23-0567-4337-8bbb-727ac3fef6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:40.258177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a6b23-0567-4337-8bbb-727ac3fef6a2 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:40.260142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 656/1309] 10.222.0.50 () {54 vars in 964 bytes} [Tue Jul 12 17:18:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:40.267146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e870c-c8a2-44b1-9665-3ef08cd2eb27 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:40.267503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e870c-c8a2-44b1-9665-3ef08cd2eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:40.267891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e870c-c8a2-44b1-9665-3ef08cd2eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:40.355652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ea5e870c-c8a2-44b1-9665-3ef08cd2eb27 None None] MFA Rules not processed for user `164446c4b65e4043a492dc626a571e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:40.357051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ea5e870c-c8a2-44b1-9665-3ef08cd2eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:40.388914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:40.462853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 654/1310] 10.222.0.50 () {58 vars in 1061 bytes} [Tue Jul 12 17:18:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:40.472766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6b23-0567-4337-8bbb-727ac3fef6a2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:18:40.474648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe4a6b23-0567-4337-8bbb-727ac3fef6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:40.616698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a6b23-0567-4337-8bbb-727ac3fef6a2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:18:40.700068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895bcc-fe45-4b5d-85dc-08a045d1c4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:18:40.701005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895bcc-fe45-4b5d-85dc-08a045d1c4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:40.701447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895bcc-fe45-4b5d-85dc-08a045d1c4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:40.701876 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895bcc-fe45-4b5d-85dc-08a045d1c4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:40.703709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7895bcc-fe45-4b5d-85dc-08a045d1c4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:40.763692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:40.823838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895bcc-fe45-4b5d-85dc-08a045d1c4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:18:40.825564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7895bcc-fe45-4b5d-85dc-08a045d1c4d4 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:18:40.846729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 657/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:18:43.209596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc103a82-d21c-4416-86e7-a82c6dd71dc7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:43.210113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc103a82-d21c-4416-86e7-a82c6dd71dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:43.210113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc103a82-d21c-4416-86e7-a82c6dd71dc7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:43.211517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 655/1312] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:43.216790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b407ce-0b3a-40be-b80c-00fbec022c9a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:43.217235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b407ce-0b3a-40be-b80c-00fbec022c9a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:43.217320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b407ce-0b3a-40be-b80c-00fbec022c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:43.300076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-35b407ce-0b3a-40be-b80c-00fbec022c9a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:43.301284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-35b407ce-0b3a-40be-b80c-00fbec022c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:43.401723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 658/1313] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:43.439817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc103a82-d21c-4416-86e7-a82c6dd71dc7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:18:43.441558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc103a82-d21c-4416-86e7-a82c6dd71dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:43.550003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc103a82-d21c-4416-86e7-a82c6dd71dc7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:18:43.637034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:43.640455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a76c8c-cd7f-4fc6-b000-18c746701b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:18:43.641176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76c8c-cd7f-4fc6-b000-18c746701b6e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:43.641470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76c8c-cd7f-4fc6-b000-18c746701b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:43.641750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a76c8c-cd7f-4fc6-b000-18c746701b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:43.644251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-36a76c8c-cd7f-4fc6-b000-18c746701b6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:43.775406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a76c8c-cd7f-4fc6-b000-18c746701b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:18:43.776974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a76c8c-cd7f-4fc6-b000-18c746701b6e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:18:43.795884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 656/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:18:46.156948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a6862-e65c-43ca-86bf-8e68b65493c4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:46.157792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a6862-e65c-43ca-86bf-8e68b65493c4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:46.157902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a6862-e65c-43ca-86bf-8e68b65493c4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:46.160683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 659/1315] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:18:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:46.166244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e30a69-8b5a-417e-a8ac-4aecd69789a9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:46.166698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e30a69-8b5a-417e-a8ac-4aecd69789a9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:46.166995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e30a69-8b5a-417e-a8ac-4aecd69789a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:46.236603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-44e30a69-8b5a-417e-a8ac-4aecd69789a9 None None] MFA Rules not processed for user `641b5e5c724f4458b0f4a4af57df9509`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:46.238775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44e30a69-8b5a-417e-a8ac-4aecd69789a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:46.293773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:46.347414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 657/1316] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:18:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:46.390371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a6862-e65c-43ca-86bf-8e68b65493c4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:18:46.392807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1a8a6862-e65c-43ca-86bf-8e68b65493c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:46.409377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:46.521315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a6862-e65c-43ca-86bf-8e68b65493c4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:18:46.606588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f4a3f-066b-457f-896e-b4a2356320ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:18:46.607596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4a3f-066b-457f-896e-b4a2356320ee service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:46.608011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4a3f-066b-457f-896e-b4a2356320ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:46.608413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f4a3f-066b-457f-896e-b4a2356320ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:46.611192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d66f4a3f-066b-457f-896e-b4a2356320ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:46.683523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:46.733002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4a3f-066b-457f-896e-b4a2356320ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:18:46.734470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f4a3f-066b-457f-896e-b4a2356320ee service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:18:46.755071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 660/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:18:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:18:49.353498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e13ca-3527-45fe-9e46-d685d573ac5f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:49.354060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e13ca-3527-45fe-9e46-d685d573ac5f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:49.354060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e13ca-3527-45fe-9e46-d685d573ac5f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:49.355523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 658/1318] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:49.361241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0bd8-8641-4907-88ee-39f35563bf7a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:49.361638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0bd8-8641-4907-88ee-39f35563bf7a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:49.361799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d0bd8-8641-4907-88ee-39f35563bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:49.428085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8d2d0bd8-8641-4907-88ee-39f35563bf7a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:49.429330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8d2d0bd8-8641-4907-88ee-39f35563bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:49.534307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 661/1319] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:49.593848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2351-15f4-406a-9861-d0cf1a8d4955 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:49.594223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2351-15f4-406a-9861-d0cf1a8d4955 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:49.594596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2351-15f4-406a-9861-d0cf1a8d4955 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:49.596065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 659/1320] 10.222.0.50 () {54 vars in 964 bytes} [Tue Jul 12 17:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:49.602350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820558a2-6eb3-464d-93a1-f7a40803af4b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:49.602674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820558a2-6eb3-464d-93a1-f7a40803af4b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:49.602941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820558a2-6eb3-464d-93a1-f7a40803af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:49.625946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:49.681786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-820558a2-6eb3-464d-93a1-f7a40803af4b None None] MFA Rules not processed for user `164446c4b65e4043a492dc626a571e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:49.683021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-820558a2-6eb3-464d-93a1-f7a40803af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:49.761781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 662/1321] 10.222.0.50 () {58 vars in 1061 bytes} [Tue Jul 12 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:49.773719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2351-15f4-406a-9861-d0cf1a8d4955 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:18:49.775306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b59e2351-15f4-406a-9861-d0cf1a8d4955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:49.885268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2351-15f4-406a-9861-d0cf1a8d4955 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:18:49.970822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a01002-2d25-4ec4-a2d0-73e309d1d6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:18:49.971484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01002-2d25-4ec4-a2d0-73e309d1d6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:49.971765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01002-2d25-4ec4-a2d0-73e309d1d6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:49.972167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a01002-2d25-4ec4-a2d0-73e309d1d6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:49.974105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60a01002-2d25-4ec4-a2d0-73e309d1d6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:49.982073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:50.092910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a01002-2d25-4ec4-a2d0-73e309d1d6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:18:50.094387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a01002-2d25-4ec4-a2d0-73e309d1d6f9 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:18:50.113891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 660/1322] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:18:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:18:53.292953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7ab14-beda-4648-b494-d32de4807d70 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:53.293546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7ab14-beda-4648-b494-d32de4807d70 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:53.293546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7ab14-beda-4648-b494-d32de4807d70 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:53.295099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 663/1323] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:53.300411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436840-b9b6-458d-9010-95c9da8b90f7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:53.300842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436840-b9b6-458d-9010-95c9da8b90f7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:53.301091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7436840-b9b6-458d-9010-95c9da8b90f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:53.372014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b7436840-b9b6-458d-9010-95c9da8b90f7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:53.373121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b7436840-b9b6-458d-9010-95c9da8b90f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:53.435746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:53.481156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 661/1324] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:53.517287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7ab14-beda-4648-b494-d32de4807d70 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:18:53.518973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04b7ab14-beda-4648-b494-d32de4807d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:53.641727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7ab14-beda-4648-b494-d32de4807d70 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:18:53.654450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:53.718108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74742e2f-e2a4-4302-b0f0-f9e09361b782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:18:53.718801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742e2f-e2a4-4302-b0f0-f9e09361b782 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:53.719083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742e2f-e2a4-4302-b0f0-f9e09361b782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:53.719353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74742e2f-e2a4-4302-b0f0-f9e09361b782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:53.720999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74742e2f-e2a4-4302-b0f0-f9e09361b782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:53.835366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74742e2f-e2a4-4302-b0f0-f9e09361b782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:18:53.836808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74742e2f-e2a4-4302-b0f0-f9e09361b782 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:18:53.855210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 664/1325] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:18:55.994950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657335-f40b-41c9-aea6-1d824956db01 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:55.995531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657335-f40b-41c9-aea6-1d824956db01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:55.995531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657335-f40b-41c9-aea6-1d824956db01 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:55.996795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 662/1326] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:56.002305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc04da-28c8-4a65-9d0d-9ac7f4ac3913 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:56.002763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc04da-28c8-4a65-9d0d-9ac7f4ac3913 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:56.002866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc04da-28c8-4a65-9d0d-9ac7f4ac3913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:56.050638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:56.069592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-53bc04da-28c8-4a65-9d0d-9ac7f4ac3913 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:56.070819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-53bc04da-28c8-4a65-9d0d-9ac7f4ac3913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:56.170923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 665/1327] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:56.206367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5657335-f40b-41c9-aea6-1d824956db01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:18:56.208070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5657335-f40b-41c9-aea6-1d824956db01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:56.325656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5657335-f40b-41c9-aea6-1d824956db01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:18:56.408220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31fea2-d264-4bbf-92f9-1a108d51dca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:18:56.408895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31fea2-d264-4bbf-92f9-1a108d51dca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:56.409173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31fea2-d264-4bbf-92f9-1a108d51dca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:56.409551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31fea2-d264-4bbf-92f9-1a108d51dca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:56.411718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a31fea2-d264-4bbf-92f9-1a108d51dca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:56.431644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:56.530942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31fea2-d264-4bbf-92f9-1a108d51dca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:18:56.532415 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31fea2-d264-4bbf-92f9-1a108d51dca5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:18:56.551629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 663/1328] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:18:58.603848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5903b-f686-4b30-8e93-36f3ad6332e9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:58.604322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5903b-f686-4b30-8e93-36f3ad6332e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:58.604412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5903b-f686-4b30-8e93-36f3ad6332e9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:58.605774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 666/1329] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:18:58.611084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29ced-d240-4f7b-ae7f-63cad0540f4d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:58.611623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29ced-d240-4f7b-ae7f-63cad0540f4d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:58.611623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29ced-d240-4f7b-ae7f-63cad0540f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:58.676939 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-56e29ced-d240-4f7b-ae7f-63cad0540f4d None None] MFA Rules not processed for user `641b5e5c724f4458b0f4a4af57df9509`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:18:58.678156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-56e29ced-d240-4f7b-ae7f-63cad0540f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:58.748036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:58.782944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 664/1330] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:18:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:18:58.821318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5903b-f686-4b30-8e93-36f3ad6332e9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:18:58.822954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c7e5903b-f686-4b30-8e93-36f3ad6332e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:58.936494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5903b-f686-4b30-8e93-36f3ad6332e9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:18:58.960380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:18:59.024794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f596023-df98-4e3f-80cf-36752a6a497d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:18:59.025350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596023-df98-4e3f-80cf-36752a6a497d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:18:59.025624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596023-df98-4e3f-80cf-36752a6a497d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:18:59.025901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f596023-df98-4e3f-80cf-36752a6a497d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:18:59.027840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3f596023-df98-4e3f-80cf-36752a6a497d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:18:59.144058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f596023-df98-4e3f-80cf-36752a6a497d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:18:59.145620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f596023-df98-4e3f-80cf-36752a6a497d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:18:59.164295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 667/1331] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:18:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:01.448122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c53ea1-9d74-4b2f-8809-a577f91d2272 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:01.448658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c53ea1-9d74-4b2f-8809-a577f91d2272 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:01.448658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c53ea1-9d74-4b2f-8809-a577f91d2272 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:01.449954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 665/1332] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:01.455795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e20358-f4c4-4fe3-a6dc-f9cc3884872a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:01.456376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e20358-f4c4-4fe3-a6dc-f9cc3884872a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:01.456376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e20358-f4c4-4fe3-a6dc-f9cc3884872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:01.519547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:01.522667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-24e20358-f4c4-4fe3-a6dc-f9cc3884872a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:01.524900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-24e20358-f4c4-4fe3-a6dc-f9cc3884872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:01.626211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 668/1333] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:19:01.663081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c53ea1-9d74-4b2f-8809-a577f91d2272 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:01.664626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-08c53ea1-9d74-4b2f-8809-a577f91d2272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:01.778849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c53ea1-9d74-4b2f-8809-a577f91d2272 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:01.860091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02504c2-12eb-43bb-991e-5a2e59dbdabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:01.860755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02504c2-12eb-43bb-991e-5a2e59dbdabb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:01.861073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02504c2-12eb-43bb-991e-5a2e59dbdabb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:01.861351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02504c2-12eb-43bb-991e-5a2e59dbdabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:01.863633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a02504c2-12eb-43bb-991e-5a2e59dbdabb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:01.891501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:01.996677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02504c2-12eb-43bb-991e-5a2e59dbdabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:01.998161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02504c2-12eb-43bb-991e-5a2e59dbdabb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:02.018210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 666/1334] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:04.076165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb410-ada5-41b8-a4aa-3aab7dd87e18 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:04.077071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb410-ada5-41b8-a4aa-3aab7dd87e18 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:04.077071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bb410-ada5-41b8-a4aa-3aab7dd87e18 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:04.079316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 669/1335] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:04.084777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14ef94-865c-435a-970c-8b5cb584c146 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:04.085224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14ef94-865c-435a-970c-8b5cb584c146 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:04.085346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14ef94-865c-435a-970c-8b5cb584c146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:04.160622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0e14ef94-865c-435a-970c-8b5cb584c146 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:04.161847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e14ef94-865c-435a-970c-8b5cb584c146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:04.246574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:04.272099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 667/1336] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:04.316132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bb410-ada5-41b8-a4aa-3aab7dd87e18 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:04.317677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d0bb410-ada5-41b8-a4aa-3aab7dd87e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:04.426520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bb410-ada5-41b8-a4aa-3aab7dd87e18 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:04.456708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:04.505947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b535a9-3148-4db3-a0d9-6d2228d6cf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:04.506551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b535a9-3148-4db3-a0d9-6d2228d6cf39 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:04.506833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b535a9-3148-4db3-a0d9-6d2228d6cf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:04.507104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b535a9-3148-4db3-a0d9-6d2228d6cf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:04.508751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-42b535a9-3148-4db3-a0d9-6d2228d6cf39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:04.623564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b535a9-3148-4db3-a0d9-6d2228d6cf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:04.625014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b535a9-3148-4db3-a0d9-6d2228d6cf39 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:04.643727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 670/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:07.005461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff1d9-e341-475e-bb46-7c44745f3d86 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:07.006017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff1d9-e341-475e-bb46-7c44745f3d86 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:07.006017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bff1d9-e341-475e-bb46-7c44745f3d86 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:07.007333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 668/1338] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:07.013813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f311-6e46-4053-9eda-1e8e54b402af None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:07.014619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f311-6e46-4053-9eda-1e8e54b402af None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:07.014763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1f311-6e46-4053-9eda-1e8e54b402af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:07.088885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-48b1f311-6e46-4053-9eda-1e8e54b402af None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:07.090144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-48b1f311-6e46-4053-9eda-1e8e54b402af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:07.099242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:07.197531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 671/1339] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:07.233260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bff1d9-e341-475e-bb46-7c44745f3d86 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:07.234856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-29bff1d9-e341-475e-bb46-7c44745f3d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:07.347969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bff1d9-e341-475e-bb46-7c44745f3d86 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:07.433101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bff16-8a71-4f83-8d31-657aff00cb6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:07.433761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bff16-8a71-4f83-8d31-657aff00cb6f service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:07.434035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bff16-8a71-4f83-8d31-657aff00cb6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:07.434295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bff16-8a71-4f83-8d31-657aff00cb6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:07.436000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-741bff16-8a71-4f83-8d31-657aff00cb6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:07.473587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:07.555441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bff16-8a71-4f83-8d31-657aff00cb6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:07.557796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bff16-8a71-4f83-8d31-657aff00cb6f service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:07.581684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 669/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:11.578239 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b5be3-6998-4a68-af35-0795d414d1c8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:11.579257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b5be3-6998-4a68-af35-0795d414d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:11.579737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b5be3-6998-4a68-af35-0795d414d1c8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:11.581817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 672/1341] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:11.587080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416cb1-7734-4766-bbc8-d52725f8db91 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:11.587548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416cb1-7734-4766-bbc8-d52725f8db91 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:11.588001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416cb1-7734-4766-bbc8-d52725f8db91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:11.662188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-52416cb1-7734-4766-bbc8-d52725f8db91 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:11.663543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-52416cb1-7734-4766-bbc8-d52725f8db91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:11.754952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:11.767349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 670/1342] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:11.806143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b5be3-6998-4a68-af35-0795d414d1c8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:11.807735 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a27b5be3-6998-4a68-af35-0795d414d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:11.919061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b5be3-6998-4a68-af35-0795d414d1c8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:11.958576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:11.999925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270f81e-4342-4836-aed1-62eee1c29d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:12.000677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f81e-4342-4836-aed1-62eee1c29d2f service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:12.001026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f81e-4342-4836-aed1-62eee1c29d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:12.001369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270f81e-4342-4836-aed1-62eee1c29d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:12.003639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2270f81e-4342-4836-aed1-62eee1c29d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:12.121955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270f81e-4342-4836-aed1-62eee1c29d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:12.123478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270f81e-4342-4836-aed1-62eee1c29d2f service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:12.142761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 673/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:14.769453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ecf8a-8676-44c6-8566-09b946649182 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:14.770014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ecf8a-8676-44c6-8566-09b946649182 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:14.770014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ecf8a-8676-44c6-8566-09b946649182 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:14.771437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 671/1344] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:14.777099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1f65-9534-4381-902f-9cdef0f598fd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:14.777544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1f65-9534-4381-902f-9cdef0f598fd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:14.777794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba1f65-9534-4381-902f-9cdef0f598fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:14.857642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4dba1f65-9534-4381-902f-9cdef0f598fd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:14.858814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4dba1f65-9534-4381-902f-9cdef0f598fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:14.880756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:14.978306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 674/1345] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:15.017938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ecf8a-8676-44c6-8566-09b946649182 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:15.020241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-672ecf8a-8676-44c6-8566-09b946649182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:15.133266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ecf8a-8676-44c6-8566-09b946649182 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:15.207786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6833f24-4455-4f31-ad4c-5140ddbddb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:15.208458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833f24-4455-4f31-ad4c-5140ddbddb94 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:15.208737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833f24-4455-4f31-ad4c-5140ddbddb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:15.209006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6833f24-4455-4f31-ad4c-5140ddbddb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:15.210749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e6833f24-4455-4f31-ad4c-5140ddbddb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:15.258310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:15.330306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6833f24-4455-4f31-ad4c-5140ddbddb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:15.331955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6833f24-4455-4f31-ad4c-5140ddbddb94 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:15.352044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 672/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:19.561786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c24e-9e0c-4a85-a133-4cfa8511f41e None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:19.562371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c24e-9e0c-4a85-a133-4cfa8511f41e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:19.562371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9158c24e-9e0c-4a85-a133-4cfa8511f41e None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:19.563976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 675/1347] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:19.570108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beee5a-5f83-48a9-905f-c935bcbb4321 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:19.570651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beee5a-5f83-48a9-905f-c935bcbb4321 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:19.570651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5beee5a-5f83-48a9-905f-c935bcbb4321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:19.639636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b5beee5a-5f83-48a9-905f-c935bcbb4321 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:19.640857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5beee5a-5f83-48a9-905f-c935bcbb4321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:19.760936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:19.763927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 673/1348] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:19.802898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158c24e-9e0c-4a85-a133-4cfa8511f41e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:19.804575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9158c24e-9e0c-4a85-a133-4cfa8511f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:19.917587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9158c24e-9e0c-4a85-a133-4cfa8511f41e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:19.966866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:20.001512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8476f-fa4e-4fb4-8e2a-3ce3eafa005c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:20.001512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8476f-fa4e-4fb4-8e2a-3ce3eafa005c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:20.001747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8476f-fa4e-4fb4-8e2a-3ce3eafa005c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:20.001977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8476f-fa4e-4fb4-8e2a-3ce3eafa005c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:20.003930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46f8476f-fa4e-4fb4-8e2a-3ce3eafa005c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:20.135675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8476f-fa4e-4fb4-8e2a-3ce3eafa005c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:20.137224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f8476f-fa4e-4fb4-8e2a-3ce3eafa005c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:20.159314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 676/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:25.170676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34175366-fa7b-46da-ba0d-2516c14c113d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:25.171187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34175366-fa7b-46da-ba0d-2516c14c113d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:25.171187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34175366-fa7b-46da-ba0d-2516c14c113d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:25.172674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 674/1350] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:25.188186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dd763-a94f-434c-92ff-02063252032c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:25.189102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dd763-a94f-434c-92ff-02063252032c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:25.189531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dd763-a94f-434c-92ff-02063252032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:25.272857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a12dd763-a94f-434c-92ff-02063252032c None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:25.274453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a12dd763-a94f-434c-92ff-02063252032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:25.294550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:25.418540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 677/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:19:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:29.419124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135c537-e117-4679-81a2-35ec355dafd0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:29.420160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135c537-e117-4679-81a2-35ec355dafd0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:29.420764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135c537-e117-4679-81a2-35ec355dafd0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:29.422318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 675/1352] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:29.427518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f201a-d8cc-4e5d-b30d-4ecb6f183643 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:29.427958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f201a-d8cc-4e5d-b30d-4ecb6f183643 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:29.428114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f201a-d8cc-4e5d-b30d-4ecb6f183643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:29.508118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a41f201a-d8cc-4e5d-b30d-4ecb6f183643 None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:29.509486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a41f201a-d8cc-4e5d-b30d-4ecb6f183643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:29.585410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:29.629759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 678/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:19:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:31.176106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d92e2-dd16-4f4a-9508-e885bacc354d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:31.176715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d92e2-dd16-4f4a-9508-e885bacc354d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:31.176715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d92e2-dd16-4f4a-9508-e885bacc354d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:31.179048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 676/1354] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:31.184367 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b3514-1b17-4ae7-bada-403beb966c57 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:31.184840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b3514-1b17-4ae7-bada-403beb966c57 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:31.184936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b3514-1b17-4ae7-bada-403beb966c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:31.264112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fc5b3514-1b17-4ae7-bada-403beb966c57 None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:31.265315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc5b3514-1b17-4ae7-bada-403beb966c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:31.385818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 679/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:19:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:19:34.752416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a6ed-1f88-46e7-9730-0dd7b06db747 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:34.753541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a6ed-1f88-46e7-9730-0dd7b06db747 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:34.753541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a6ed-1f88-46e7-9730-0dd7b06db747 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:34.755217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 677/1356] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:34.760173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed31af-9ec0-4420-8027-c213c6084b0c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:34.761014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed31af-9ec0-4420-8027-c213c6084b0c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:34.761521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed31af-9ec0-4420-8027-c213c6084b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:34.811757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:34.852982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-02ed31af-9ec0-4420-8027-c213c6084b0c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:34.854884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02ed31af-9ec0-4420-8027-c213c6084b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:34.960563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 680/1357] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:35.015790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1bf5f-b219-477e-9fa8-1a20acd84756 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:35.016534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1bf5f-b219-477e-9fa8-1a20acd84756 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:35.017220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1bf5f-b219-477e-9fa8-1a20acd84756 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:35.019821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 678/1358] 10.222.0.50 () {54 vars in 961 bytes} [Tue Jul 12 17:19:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:35.028625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c744-a364-47d5-a170-2d62b7489b33 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:35.029214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c744-a364-47d5-a170-2d62b7489b33 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:35.030199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224c744-a364-47d5-a170-2d62b7489b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:35.120802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7224c744-a364-47d5-a170-2d62b7489b33 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:35.121886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7224c744-a364-47d5-a170-2d62b7489b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:35.176399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:35.252811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 681/1359] 10.222.0.50 () {58 vars in 1058 bytes} [Tue Jul 12 17:19:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:35.261067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1bf5f-b219-477e-9fa8-1a20acd84756 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:35.262781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f1a1bf5f-b219-477e-9fa8-1a20acd84756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:35.419908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1bf5f-b219-477e-9fa8-1a20acd84756 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:35.506957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:35.549018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcb6f4-df5b-4841-9202-b866b76a0c25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:35.550031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb6f4-df5b-4841-9202-b866b76a0c25 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:35.550504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb6f4-df5b-4841-9202-b866b76a0c25 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:35.550781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb6f4-df5b-4841-9202-b866b76a0c25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:35.552427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-71dcb6f4-df5b-4841-9202-b866b76a0c25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:35.651731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcb6f4-df5b-4841-9202-b866b76a0c25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:35.653344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcb6f4-df5b-4841-9202-b866b76a0c25 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:35.684877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 679/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:37.910958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf5a5-8dc0-43ea-8180-f8b8e33c3999 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:37.911348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf5a5-8dc0-43ea-8180-f8b8e33c3999 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:37.911799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf5a5-8dc0-43ea-8180-f8b8e33c3999 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:37.917376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 682/1361] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:37.919228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f0229-1b14-4e05-9168-d4eb6a35b954 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:37.919631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f0229-1b14-4e05-9168-d4eb6a35b954 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:37.919871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f0229-1b14-4e05-9168-d4eb6a35b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:37.996012 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1c3f0229-1b14-4e05-9168-d4eb6a35b954 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:37.997203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1c3f0229-1b14-4e05-9168-d4eb6a35b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:38.037708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:38.104834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 680/1362] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:38.154106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf5a5-8dc0-43ea-8180-f8b8e33c3999 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:38.155888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-348cf5a5-8dc0-43ea-8180-f8b8e33c3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:38.353782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf5a5-8dc0-43ea-8180-f8b8e33c3999 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:38.367162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:38.498864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba1071a-9b3c-4363-86a7-b809ea8bb929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:38.499593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1071a-9b3c-4363-86a7-b809ea8bb929 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:38.499970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1071a-9b3c-4363-86a7-b809ea8bb929 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:38.500254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba1071a-9b3c-4363-86a7-b809ea8bb929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:38.501892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fba1071a-9b3c-4363-86a7-b809ea8bb929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:38.613597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1071a-9b3c-4363-86a7-b809ea8bb929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:38.615277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba1071a-9b3c-4363-86a7-b809ea8bb929 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:38.639055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 683/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:41.038461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ba63-4b2a-49c3-9d63-f3ff874dbbf5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:41.039321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ba63-4b2a-49c3-9d63-f3ff874dbbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:41.039784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0ba63-4b2a-49c3-9d63-f3ff874dbbf5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:41.043628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 681/1364] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:41.047486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b090-6b5b-4774-b912-077d32062eff None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:41.047486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b090-6b5b-4774-b912-077d32062eff None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:41.047486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b090-6b5b-4774-b912-077d32062eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:41.062638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:41.120916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8dd5b090-6b5b-4774-b912-077d32062eff None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:41.122252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8dd5b090-6b5b-4774-b912-077d32062eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:41.226426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 684/1365] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:41.271799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275a9e-9244-4552-b8ff-15121c594695 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:41.272095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275a9e-9244-4552-b8ff-15121c594695 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:41.272362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f275a9e-9244-4552-b8ff-15121c594695 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:41.273925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 682/1366] 10.222.0.50 () {54 vars in 961 bytes} [Tue Jul 12 17:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:41.279156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15afd9-b111-44f9-8da1-298242922462 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:41.279448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15afd9-b111-44f9-8da1-298242922462 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:41.279724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15afd9-b111-44f9-8da1-298242922462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:41.361990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2f15afd9-b111-44f9-8da1-298242922462 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:41.363794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f15afd9-b111-44f9-8da1-298242922462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:41.403356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:41.492481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 685/1367] 10.222.0.50 () {58 vars in 1058 bytes} [Tue Jul 12 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:41.501151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275a9e-9244-4552-b8ff-15121c594695 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:41.503307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5f275a9e-9244-4552-b8ff-15121c594695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:41.688638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f275a9e-9244-4552-b8ff-15121c594695 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:41.711570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:41.813192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82476150-9439-494c-888a-d9933f001629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:41.813981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82476150-9439-494c-888a-d9933f001629 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:41.814375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82476150-9439-494c-888a-d9933f001629 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:41.814712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82476150-9439-494c-888a-d9933f001629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:41.816506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82476150-9439-494c-888a-d9933f001629 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:41.911297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82476150-9439-494c-888a-d9933f001629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:41.913089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82476150-9439-494c-888a-d9933f001629 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:41.935121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 683/1368] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:42.879827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df3e37-0959-4633-96de-ec919a9ccde5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:42.880370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df3e37-0959-4633-96de-ec919a9ccde5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:42.880567 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df3e37-0959-4633-96de-ec919a9ccde5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:42.882247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 686/1369] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:42.887690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20bb7-d05c-42de-89ef-f4e82db0a1ce None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:42.888142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20bb7-d05c-42de-89ef-f4e82db0a1ce None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:42.888423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20bb7-d05c-42de-89ef-f4e82db0a1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:42.921816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:42.958819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-64f20bb7-d05c-42de-89ef-f4e82db0a1ce None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:42.960168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64f20bb7-d05c-42de-89ef-f4e82db0a1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:43.060265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 684/1370] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:43.368792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca06fc-163f-4767-bb28-238511d43657 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:43.369056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca06fc-163f-4767-bb28-238511d43657 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:43.369350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca06fc-163f-4767-bb28-238511d43657 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:43.370914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 687/1371] 10.222.0.50 () {54 vars in 963 bytes} [Tue Jul 12 17:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:19:43.375900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4d08-f0b5-4b8b-ad39-761e6342745f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:43.376466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4d08-f0b5-4b8b-ad39-761e6342745f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:43.376961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4d08-f0b5-4b8b-ad39-761e6342745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:43.454693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8ff4d08-f0b5-4b8b-ad39-761e6342745f None None] MFA Rules not processed for user `c30dd51dbbb245a485be48fce34295e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:43.456008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8ff4d08-f0b5-4b8b-ad39-761e6342745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:43.507463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:43.543656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 685/1372] 10.222.0.50 () {58 vars in 1060 bytes} [Tue Jul 12 17:19:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:43.551738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca06fc-163f-4767-bb28-238511d43657 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:43.553258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c9ca06fc-163f-4767-bb28-238511d43657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:43.677849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca06fc-163f-4767-bb28-238511d43657 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:43.720360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:43.760736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f054c45-2fc5-48fd-a596-bd5b9a81d313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:43.761370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054c45-2fc5-48fd-a596-bd5b9a81d313 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:43.761685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054c45-2fc5-48fd-a596-bd5b9a81d313 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:43.761958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054c45-2fc5-48fd-a596-bd5b9a81d313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:43.763631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4f054c45-2fc5-48fd-a596-bd5b9a81d313 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:43.883000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f054c45-2fc5-48fd-a596-bd5b9a81d313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:43.884489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f054c45-2fc5-48fd-a596-bd5b9a81d313 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:43.903942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 688/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:44.060614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e942e69-82cc-4e51-bec6-d8dccf634397 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:44.062020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e942e69-82cc-4e51-bec6-d8dccf634397 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:44.062928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e942e69-82cc-4e51-bec6-d8dccf634397 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:44.066959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 686/1374] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:44.071756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbcf62-489c-4a2f-b006-5ea69c8ee8b3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:44.072079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbcf62-489c-4a2f-b006-5ea69c8ee8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:44.072324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbcf62-489c-4a2f-b006-5ea69c8ee8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:44.139156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5ddbcf62-489c-4a2f-b006-5ea69c8ee8b3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:44.140267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5ddbcf62-489c-4a2f-b006-5ea69c8ee8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:44.161843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:44.254591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 689/1375] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:44.284158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e942e69-82cc-4e51-bec6-d8dccf634397 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:44.285674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0e942e69-82cc-4e51-bec6-d8dccf634397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:44.448953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e942e69-82cc-4e51-bec6-d8dccf634397 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:44.500206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:44.565164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6f211-3ca1-411a-8a75-e22db7a7d519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:44.565928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f211-3ca1-411a-8a75-e22db7a7d519 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:44.566346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f211-3ca1-411a-8a75-e22db7a7d519 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:44.566919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6f211-3ca1-411a-8a75-e22db7a7d519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:44.568744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dee6f211-3ca1-411a-8a75-e22db7a7d519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:44.671586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f211-3ca1-411a-8a75-e22db7a7d519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:44.673193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6f211-3ca1-411a-8a75-e22db7a7d519 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:44.692507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 687/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:46.808002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439580c1-cd7f-4ae9-815f-813f5045da4b None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:46.808545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439580c1-cd7f-4ae9-815f-813f5045da4b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:46.808545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439580c1-cd7f-4ae9-815f-813f5045da4b None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:46.809946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 690/1377] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:46.815783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0884-0c9b-4bee-bf2a-775a78a474bd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:46.816206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0884-0c9b-4bee-bf2a-775a78a474bd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:46.816354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e0884-0c9b-4bee-bf2a-775a78a474bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:46.909293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f2e0884-0c9b-4bee-bf2a-775a78a474bd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:46.913654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f2e0884-0c9b-4bee-bf2a-775a78a474bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:46.925482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:47.028102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 688/1378] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:47.077965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439580c1-cd7f-4ae9-815f-813f5045da4b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:47.079627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-439580c1-cd7f-4ae9-815f-813f5045da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:47.233220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439580c1-cd7f-4ae9-815f-813f5045da4b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:47.236795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:47.364175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77fe74-7d8d-40b1-8261-5de387b8e3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:47.364835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fe74-7d8d-40b1-8261-5de387b8e3e9 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:47.365119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fe74-7d8d-40b1-8261-5de387b8e3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:47.365393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fe74-7d8d-40b1-8261-5de387b8e3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:47.367090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae77fe74-7d8d-40b1-8261-5de387b8e3e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:47.500092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fe74-7d8d-40b1-8261-5de387b8e3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:47.502171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77fe74-7d8d-40b1-8261-5de387b8e3e9 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:47.532192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 691/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:49.609459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b156-7dfb-4a3f-9abb-54e796cc46d9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:49.609963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b156-7dfb-4a3f-9abb-54e796cc46d9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:49.610048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62b156-7dfb-4a3f-9abb-54e796cc46d9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:49.611775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 689/1380] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:49.617991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9882-0ae1-4506-add3-349f8c3c9ee1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:49.618439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9882-0ae1-4506-add3-349f8c3c9ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:49.618636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f9882-0ae1-4506-add3-349f8c3c9ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:49.629295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:49.686144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a76f9882-0ae1-4506-add3-349f8c3c9ee1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:49.687366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a76f9882-0ae1-4506-add3-349f8c3c9ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:49.791780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 692/1381] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:49.836223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b156-7dfb-4a3f-9abb-54e796cc46d9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:49.837671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db62b156-7dfb-4a3f-9abb-54e796cc46d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:49.978852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:49.991977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62b156-7dfb-4a3f-9abb-54e796cc46d9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:50.115556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d0548-2091-4e51-8310-6585182f9c71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:50.116124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d0548-2091-4e51-8310-6585182f9c71 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:50.116416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d0548-2091-4e51-8310-6585182f9c71 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:50.116687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d0548-2091-4e51-8310-6585182f9c71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:50.118369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb4d0548-2091-4e51-8310-6585182f9c71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:50.212771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d0548-2091-4e51-8310-6585182f9c71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:50.214438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d0548-2091-4e51-8310-6585182f9c71 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:50.225685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:50.247311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 690/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:52.394706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632f1e-a305-45bb-8d9b-b6996e3a00d8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:52.395320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632f1e-a305-45bb-8d9b-b6996e3a00d8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:52.395320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632f1e-a305-45bb-8d9b-b6996e3a00d8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:52.397023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 693/1383] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:52.402576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061cfd8-fa14-4c10-9f86-d9eb6a2d0a12 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:52.403123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061cfd8-fa14-4c10-9f86-d9eb6a2d0a12 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:52.403123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061cfd8-fa14-4c10-9f86-d9eb6a2d0a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:52.469215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c061cfd8-fa14-4c10-9f86-d9eb6a2d0a12 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:52.470505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c061cfd8-fa14-4c10-9f86-d9eb6a2d0a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:52.575083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 691/1384] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:52.618578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632f1e-a305-45bb-8d9b-b6996e3a00d8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:52.620793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d0632f1e-a305-45bb-8d9b-b6996e3a00d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:52.708018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:52.783574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632f1e-a305-45bb-8d9b-b6996e3a00d8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:52.918758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087ad64-5db7-4d63-a8e1-b76a62f3151f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:52.919592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ad64-5db7-4d63-a8e1-b76a62f3151f service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:52.919948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ad64-5db7-4d63-a8e1-b76a62f3151f service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:52.920327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087ad64-5db7-4d63-a8e1-b76a62f3151f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:52.922585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1087ad64-5db7-4d63-a8e1-b76a62f3151f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:52.980973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:53.022312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087ad64-5db7-4d63-a8e1-b76a62f3151f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:53.023955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087ad64-5db7-4d63-a8e1-b76a62f3151f service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:53.042673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 694/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:55.091918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c73be-e8f5-48b4-a9cb-219f9118baf2 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:55.092523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c73be-e8f5-48b4-a9cb-219f9118baf2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:55.092757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c73be-e8f5-48b4-a9cb-219f9118baf2 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:55.094640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 692/1386] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:55.100109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eec8e-d808-4b77-832a-aa622ce669d5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:55.100530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eec8e-d808-4b77-832a-aa622ce669d5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:55.100678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320eec8e-d808-4b77-832a-aa622ce669d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:55.176413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-320eec8e-d808-4b77-832a-aa622ce669d5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:55.178094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-320eec8e-d808-4b77-832a-aa622ce669d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:55.304628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 695/1387] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:55.352888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c73be-e8f5-48b4-a9cb-219f9118baf2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:55.354936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-073c73be-e8f5-48b4-a9cb-219f9118baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:55.444552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:55.517059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c73be-e8f5-48b4-a9cb-219f9118baf2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:55.662212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2460c5-96bd-4f16-9412-94917bffcfec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:55.662912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2460c5-96bd-4f16-9412-94917bffcfec service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:55.663193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2460c5-96bd-4f16-9412-94917bffcfec service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:55.663465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2460c5-96bd-4f16-9412-94917bffcfec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:55.665162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2f2460c5-96bd-4f16-9412-94917bffcfec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:55.706186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:55.762279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2460c5-96bd-4f16-9412-94917bffcfec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:55.764561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2460c5-96bd-4f16-9412-94917bffcfec service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:55.788177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 693/1388] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:57.843232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd124c-e77a-4290-bb8e-fad89386364a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:57.843895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd124c-e77a-4290-bb8e-fad89386364a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:57.843895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd124c-e77a-4290-bb8e-fad89386364a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:57.845164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 696/1389] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:57.850889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a683f8-cbc8-49c4-9937-26816af915cc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:57.851323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a683f8-cbc8-49c4-9937-26816af915cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:57.851427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a683f8-cbc8-49c4-9937-26816af915cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:57.920035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-11a683f8-cbc8-49c4-9937-26816af915cc None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:57.921259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-11a683f8-cbc8-49c4-9937-26816af915cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:58.025831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 694/1390] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:58.069955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd124c-e77a-4290-bb8e-fad89386364a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:58.071544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dcbd124c-e77a-4290-bb8e-fad89386364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:58.105634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:58.224946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd124c-e77a-4290-bb8e-fad89386364a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:58.328500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:58.340328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b890e-0c50-4396-9a6d-ead6e1538627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:58.341001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b890e-0c50-4396-9a6d-ead6e1538627 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:58.341280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b890e-0c50-4396-9a6d-ead6e1538627 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:58.341550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b890e-0c50-4396-9a6d-ead6e1538627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:58.343226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-208b890e-0c50-4396-9a6d-ead6e1538627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:58.436371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b890e-0c50-4396-9a6d-ead6e1538627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:58.437894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b890e-0c50-4396-9a6d-ead6e1538627 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:58.456933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 697/1391] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:19:59.046678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b7ca6-26e0-4c21-ad05-37d46a9df8dc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:59.047270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b7ca6-26e0-4c21-ad05-37d46a9df8dc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:59.047270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b7ca6-26e0-4c21-ad05-37d46a9df8dc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:59.048617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 695/1392] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:59.054330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3e1b5-35a5-4544-b6ea-d71ae9a11412 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:59.054782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3e1b5-35a5-4544-b6ea-d71ae9a11412 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:59.054893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3e1b5-35a5-4544-b6ea-d71ae9a11412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:59.123018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-29c3e1b5-35a5-4544-b6ea-d71ae9a11412 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:59.124225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-29c3e1b5-35a5-4544-b6ea-d71ae9a11412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:59.185048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:59.224704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 698/1393] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:59.280842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82adef-b50f-4eb4-ad05-53768dc6f201 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:59.281130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82adef-b50f-4eb4-ad05-53768dc6f201 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:59.281411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82adef-b50f-4eb4-ad05-53768dc6f201 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:59.282829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 696/1394] 10.222.0.50 () {54 vars in 962 bytes} [Tue Jul 12 17:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:19:59.288178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818368-3b45-45bd-993c-bc1c53724641 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:59.288501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818368-3b45-45bd-993c-bc1c53724641 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:59.288814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818368-3b45-45bd-993c-bc1c53724641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:59.365741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-26818368-3b45-45bd-993c-bc1c53724641 None None] MFA Rules not processed for user `7724df01ff1444a09a751bb54dabc222`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:19:59.367014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-26818368-3b45-45bd-993c-bc1c53724641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:59.443776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 699/1395] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Jul 12 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:19:59.451339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82adef-b50f-4eb4-ad05-53768dc6f201 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:19:59.453076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fd82adef-b50f-4eb4-ad05-53768dc6f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:59.467883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:59.563001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82adef-b50f-4eb4-ad05-53768dc6f201 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:19:59.648921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739d57f-137b-48e0-82bb-6fd61250d67d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:19:59.649498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739d57f-137b-48e0-82bb-6fd61250d67d service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:19:59.649782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739d57f-137b-48e0-82bb-6fd61250d67d service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:19:59.650054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739d57f-137b-48e0-82bb-6fd61250d67d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:19:59.651771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7739d57f-137b-48e0-82bb-6fd61250d67d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:19:59.726368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:19:59.769934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739d57f-137b-48e0-82bb-6fd61250d67d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:19:59.771409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7739d57f-137b-48e0-82bb-6fd61250d67d service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:19:59.789529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 697/1396] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:00.503814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d20f-6384-4c84-842b-3649548fe233 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:00.504335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d20f-6384-4c84-842b-3649548fe233 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:00.504438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d20f-6384-4c84-842b-3649548fe233 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:00.505914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 700/1397] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:00.506278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e124a-946f-465e-a889-3a1d22f1b3a4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:00.506695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e124a-946f-465e-a889-3a1d22f1b3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:00.506859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e124a-946f-465e-a889-3a1d22f1b3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:00.511584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118048-a982-48ef-b7a9-83ef9a6e02be None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:00.511880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118048-a982-48ef-b7a9-83ef9a6e02be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:00.512163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af118048-a982-48ef-b7a9-83ef9a6e02be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:00.577624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-042e124a-946f-465e-a889-3a1d22f1b3a4 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:00.581401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-042e124a-946f-465e-a889-3a1d22f1b3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:00.585718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-af118048-a982-48ef-b7a9-83ef9a6e02be None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:00.586986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-af118048-a982-48ef-b7a9-83ef9a6e02be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:00.598726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:00.684393 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 698/1398] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:20:00.696461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 701/1399] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:00.730939 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096157-7df3-4fca-9348-bb47347d1518 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:00.731222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096157-7df3-4fca-9348-bb47347d1518 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:00.731498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93096157-7df3-4fca-9348-bb47347d1518 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:00.732882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 699/1400] 10.222.0.50 () {54 vars in 942 bytes} [Tue Jul 12 17:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:00.739539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27ab8-5d17-418f-b55d-2bcd1a44e710 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:00.739828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27ab8-5d17-418f-b55d-2bcd1a44e710 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:00.740101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27ab8-5d17-418f-b55d-2bcd1a44e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:00.742491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096157-7df3-4fca-9348-bb47347d1518 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:00.744005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93096157-7df3-4fca-9348-bb47347d1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:00.782721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:00.816777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3ae27ab8-5d17-418f-b55d-2bcd1a44e710 None None] MFA Rules not processed for user `5731c3ee4a284ae085eedd600c21bc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:00.817990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ae27ab8-5d17-418f-b55d-2bcd1a44e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:00.890189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:00.894215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93096157-7df3-4fca-9348-bb47347d1518 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:00.938518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 702/1401] 10.222.0.50 () {58 vars in 1039 bytes} [Tue Jul 12 17:20:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:00.943904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27ab8-5d17-418f-b55d-2bcd1a44e710 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:00.955143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27ab8-5d17-418f-b55d-2bcd1a44e710 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:01.025435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:01.031413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461e618-2c0c-48b4-8173-e0a11278a15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:01.032078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e618-2c0c-48b4-8173-e0a11278a15a service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:01.032360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e618-2c0c-48b4-8173-e0a11278a15a service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:01.032629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461e618-2c0c-48b4-8173-e0a11278a15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:01.034441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c461e618-2c0c-48b4-8173-e0a11278a15a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:01.065764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426e21c-d4da-4dd0-967b-bad9ae22b808 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:01.066440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e21c-d4da-4dd0-967b-bad9ae22b808 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:01.066720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e21c-d4da-4dd0-967b-bad9ae22b808 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:01.066987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426e21c-d4da-4dd0-967b-bad9ae22b808 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:01.068649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7426e21c-d4da-4dd0-967b-bad9ae22b808 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:01.125952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461e618-2c0c-48b4-8173-e0a11278a15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:01.127643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461e618-2c0c-48b4-8173-e0a11278a15a service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:01.145646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 700/1402] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:01.155572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426e21c-d4da-4dd0-967b-bad9ae22b808 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:01.157186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426e21c-d4da-4dd0-967b-bad9ae22b808 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:01.161306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:01.167417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 703/1403] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:20:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:20:03.235629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac25b-c1c3-4b58-baa3-2409a4a9d50f None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:03.236272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac25b-c1c3-4b58-baa3-2409a4a9d50f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:03.236272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ac25b-c1c3-4b58-baa3-2409a4a9d50f None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:03.238313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 701/1404] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:03.243601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61fcd-2305-4807-a06f-d9635ee7d5cf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:03.244446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61fcd-2305-4807-a06f-d9635ee7d5cf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:03.244824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b61fcd-2305-4807-a06f-d9635ee7d5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:03.323400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c1b61fcd-2305-4807-a06f-d9635ee7d5cf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:03.324760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c1b61fcd-2305-4807-a06f-d9635ee7d5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:03.431710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 704/1405] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:03.476282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ac25b-c1c3-4b58-baa3-2409a4a9d50f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:03.478033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ac5ac25b-c1c3-4b58-baa3-2409a4a9d50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:03.616982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:03.653553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ac25b-c1c3-4b58-baa3-2409a4a9d50f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:03.778571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cc003-3db4-4af7-b4d6-35fda3c4f953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:03.779236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cc003-3db4-4af7-b4d6-35fda3c4f953 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:03.779517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cc003-3db4-4af7-b4d6-35fda3c4f953 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:03.779802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cc003-3db4-4af7-b4d6-35fda3c4f953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:03.781445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7b0cc003-3db4-4af7-b4d6-35fda3c4f953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:03.867120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:03.878580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cc003-3db4-4af7-b4d6-35fda3c4f953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:03.880212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0cc003-3db4-4af7-b4d6-35fda3c4f953 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:03.901205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 702/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:06.040421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ae2df-cc9e-4248-b810-f27dcee3d380 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:06.040989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ae2df-cc9e-4248-b810-f27dcee3d380 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:06.040989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ae2df-cc9e-4248-b810-f27dcee3d380 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:06.043510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 705/1407] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:06.048574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916f654-bde4-4695-be6b-ee17764e53a1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:06.050405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916f654-bde4-4695-be6b-ee17764e53a1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:06.051192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916f654-bde4-4695-be6b-ee17764e53a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:06.149879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3916f654-bde4-4695-be6b-ee17764e53a1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:06.151820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3916f654-bde4-4695-be6b-ee17764e53a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:06.294365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 703/1408] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:06.333056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ae2df-cc9e-4248-b810-f27dcee3d380 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:06.334601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e27ae2df-cc9e-4248-b810-f27dcee3d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:06.427398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:06.507026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ae2df-cc9e-4248-b810-f27dcee3d380 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:06.640117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0e78f-388e-497c-86fc-9cbc14c48950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:06.640814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0e78f-388e-497c-86fc-9cbc14c48950 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:06.641095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0e78f-388e-497c-86fc-9cbc14c48950 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:06.641370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0e78f-388e-497c-86fc-9cbc14c48950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:06.643064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6e0e78f-388e-497c-86fc-9cbc14c48950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:06.691991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:06.753752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0e78f-388e-497c-86fc-9cbc14c48950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:06.754745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0e78f-388e-497c-86fc-9cbc14c48950 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:06.775067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 706/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:16.286433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=74 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:16.775252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=28 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:23.116360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f87d-a1dd-4400-a1a6-c18e80569c92 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:23.116955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f87d-a1dd-4400-a1a6-c18e80569c92 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:23.116955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3f87d-a1dd-4400-a1a6-c18e80569c92 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:23.118320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 704/1410] 10.222.0.50 () {54 vars in 918 bytes} [Tue Jul 12 17:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:23.124246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190911f-e19b-4ef4-9be0-ee6a4c405288 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:23.124709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190911f-e19b-4ef4-9be0-ee6a4c405288 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:23.124817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190911f-e19b-4ef4-9be0-ee6a4c405288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:23.205564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e190911f-e19b-4ef4-9be0-ee6a4c405288 None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:23.206832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e190911f-e19b-4ef4-9be0-ee6a4c405288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:23.324139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 707/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Jul 12 17:20:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:23.341941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a3f-0a3c-44ad-a180-dc4a1b90a661 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:23.342368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a3f-0a3c-44ad-a180-dc4a1b90a661 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:23.342732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3a3f-0a3c-44ad-a180-dc4a1b90a661 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:23.344945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 705/1412] 10.222.0.50 () {54 vars in 918 bytes} [Tue Jul 12 17:20:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:23.350012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e907-83e0-4627-814a-a0a67f501778 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:23.350340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e907-83e0-4627-814a-a0a67f501778 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:23.350644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2e907-83e0-4627-814a-a0a67f501778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:23.425326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:23.429280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-eed2e907-83e0-4627-814a-a0a67f501778 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:23.431179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eed2e907-83e0-4627-814a-a0a67f501778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:23.585431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 708/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Tue Jul 12 17:20:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:20:26.089279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a8458-99ac-4b75-94bd-cd397a6ce9b9 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:26.089857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a8458-99ac-4b75-94bd-cd397a6ce9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:26.089857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a8458-99ac-4b75-94bd-cd397a6ce9b9 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:26.091274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:26.097933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be089b6-efc9-4e20-bd9e-349587963aa7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:26.098703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be089b6-efc9-4e20-bd9e-349587963aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:26.098889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be089b6-efc9-4e20-bd9e-349587963aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:26.178147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0be089b6-efc9-4e20-bd9e-349587963aa7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:26.179379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0be089b6-efc9-4e20-bd9e-349587963aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:26.239054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:26.285255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:26.328501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a8458-99ac-4b75-94bd-cd397a6ce9b9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:26.330334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b5a8458-99ac-4b75-94bd-cd397a6ce9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:26.492044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a8458-99ac-4b75-94bd-cd397a6ce9b9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:26.579998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:26.622420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f61e-c8ef-4627-a39d-a739759ef32b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:26.623078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f61e-c8ef-4627-a39d-a739759ef32b service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:26.623358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f61e-c8ef-4627-a39d-a739759ef32b service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:26.623627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f61e-c8ef-4627-a39d-a739759ef32b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:26.625278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c12f61e-c8ef-4627-a39d-a739759ef32b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:26.723097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f61e-c8ef-4627-a39d-a739759ef32b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:26.724737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f61e-c8ef-4627-a39d-a739759ef32b service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:26.745733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 707/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:27.646913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc972a3-8921-44f7-9382-b8f4cd0bb175 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:27.647411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc972a3-8921-44f7-9382-b8f4cd0bb175 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:27.647411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc972a3-8921-44f7-9382-b8f4cd0bb175 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:27.649590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:27.655574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5715-ab0b-49b9-8e66-944a76fe7788 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:27.656026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5715-ab0b-49b9-8e66-944a76fe7788 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:27.656129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5715-ab0b-49b9-8e66-944a76fe7788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:27.746219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-310d5715-ab0b-49b9-8e66-944a76fe7788 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:27.747459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-310d5715-ab0b-49b9-8e66-944a76fe7788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:27.785557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:27.866897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:28.018722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc972a3-8921-44f7-9382-b8f4cd0bb175 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:28.020403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2cc972a3-8921-44f7-9382-b8f4cd0bb175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:28.176311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc972a3-8921-44f7-9382-b8f4cd0bb175 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:28.231621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:28.308338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544f44f-2020-4dc3-91d6-e478c5f705a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:28.308994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f44f-2020-4dc3-91d6-e478c5f705a5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:28.309274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f44f-2020-4dc3-91d6-e478c5f705a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:28.309551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f44f-2020-4dc3-91d6-e478c5f705a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:28.311240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7544f44f-2020-4dc3-91d6-e478c5f705a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:28.404611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544f44f-2020-4dc3-91d6-e478c5f705a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:28.406207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544f44f-2020-4dc3-91d6-e478c5f705a5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:28.425303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 711/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:29.309966 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d443d-4a2d-4994-9739-65862f0cd337 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:29.310879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d443d-4a2d-4994-9739-65862f0cd337 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:29.310879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d443d-4a2d-4994-9739-65862f0cd337 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:29.313177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:29.319403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b887a2-f125-4706-8a01-4fc28c9964c5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:29.319858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b887a2-f125-4706-8a01-4fc28c9964c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:29.319963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b887a2-f125-4706-8a01-4fc28c9964c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:29.385206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:29.408528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f2b887a2-f125-4706-8a01-4fc28c9964c5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:29.410032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f2b887a2-f125-4706-8a01-4fc28c9964c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:29.521371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:29.676267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d443d-4a2d-4994-9739-65862f0cd337 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:29.678586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad6d443d-4a2d-4994-9739-65862f0cd337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:29.847300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d443d-4a2d-4994-9739-65862f0cd337 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:29.860531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:29.980092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdeefd7-e44f-4b81-9a52-001159fa4988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:29.980741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeefd7-e44f-4b81-9a52-001159fa4988 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:29.981011 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeefd7-e44f-4b81-9a52-001159fa4988 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:29.981289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdeefd7-e44f-4b81-9a52-001159fa4988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:29.982963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7bdeefd7-e44f-4b81-9a52-001159fa4988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:30.086990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeefd7-e44f-4b81-9a52-001159fa4988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:30.088619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdeefd7-e44f-4b81-9a52-001159fa4988 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:30.110607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 710/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:31.007510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a981596-bd52-4dbd-ae14-4043649edbb9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:31.008403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a981596-bd52-4dbd-ae14-4043649edbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:31.008403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a981596-bd52-4dbd-ae14-4043649edbb9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:31.010711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:31.018952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b65d-a72d-4faa-a5a1-acdc95cea813 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:31.019396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b65d-a72d-4faa-a5a1-acdc95cea813 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:31.019534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b65d-a72d-4faa-a5a1-acdc95cea813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:31.040697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:31.097794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-73d7b65d-a72d-4faa-a5a1-acdc95cea813 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:31.099027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-73d7b65d-a72d-4faa-a5a1-acdc95cea813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:31.204487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:31.377267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a981596-bd52-4dbd-ae14-4043649edbb9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:31.379143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a981596-bd52-4dbd-ae14-4043649edbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:31.495445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:31.534086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a981596-bd52-4dbd-ae14-4043649edbb9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:31.662678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7409b9-c0ee-4f47-af9e-0d18d89a3bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:31.663338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7409b9-c0ee-4f47-af9e-0d18d89a3bff service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:31.663621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7409b9-c0ee-4f47-af9e-0d18d89a3bff service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:31.663900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7409b9-c0ee-4f47-af9e-0d18d89a3bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:31.665569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb7409b9-c0ee-4f47-af9e-0d18d89a3bff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:31.766421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:31.781987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7409b9-c0ee-4f47-af9e-0d18d89a3bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:31.783654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7409b9-c0ee-4f47-af9e-0d18d89a3bff service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:31.804009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 714/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:32.660422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b030-42f4-42e5-b725-ac71068a4e6e None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:32.660981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b030-42f4-42e5-b725-ac71068a4e6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:32.660981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341b030-42f4-42e5-b725-ac71068a4e6e None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:32.662330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:32.668593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec9a6-572d-4743-bdf4-8b2f0143048a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:32.669282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec9a6-572d-4743-bdf4-8b2f0143048a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:32.669463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dec9a6-572d-4743-bdf4-8b2f0143048a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:32.751201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d1dec9a6-572d-4743-bdf4-8b2f0143048a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:32.752408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d1dec9a6-572d-4743-bdf4-8b2f0143048a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:32.855607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:33.021141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b030-42f4-42e5-b725-ac71068a4e6e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:33.023863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d341b030-42f4-42e5-b725-ac71068a4e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:33.118668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:33.182336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341b030-42f4-42e5-b725-ac71068a4e6e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:33.314829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0449c-7198-4ae1-bfbe-214b8b2001a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:33.316086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0449c-7198-4ae1-bfbe-214b8b2001a1 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:33.316428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0449c-7198-4ae1-bfbe-214b8b2001a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:33.316812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0449c-7198-4ae1-bfbe-214b8b2001a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:33.319482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cda0449c-7198-4ae1-bfbe-214b8b2001a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:33.373884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:33.422862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0449c-7198-4ae1-bfbe-214b8b2001a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:33.424625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0449c-7198-4ae1-bfbe-214b8b2001a1 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:33.444119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 713/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:34.243178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d19894-a99f-45bf-b767-774f0a119335 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:34.243817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d19894-a99f-45bf-b767-774f0a119335 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:34.243817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d19894-a99f-45bf-b767-774f0a119335 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:34.245117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:34.250518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e9ac-80d5-4496-b5cf-554a807bdddd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:34.250974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e9ac-80d5-4496-b5cf-554a807bdddd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:34.251078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616e9ac-80d5-4496-b5cf-554a807bdddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:34.339428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2616e9ac-80d5-4496-b5cf-554a807bdddd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:34.341256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2616e9ac-80d5-4496-b5cf-554a807bdddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:34.468573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:20:34.622733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d19894-a99f-45bf-b767-774f0a119335 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:34.624289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e5d19894-a99f-45bf-b767-774f0a119335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:34.679362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:34.790868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d19894-a99f-45bf-b767-774f0a119335 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:34.917229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32852db7-cc2b-4b3c-b223-58135649177d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:34.917798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32852db7-cc2b-4b3c-b223-58135649177d service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:34.918078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32852db7-cc2b-4b3c-b223-58135649177d service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:34.918353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32852db7-cc2b-4b3c-b223-58135649177d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:34.920039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-32852db7-cc2b-4b3c-b223-58135649177d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:34.927411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:35.024471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32852db7-cc2b-4b3c-b223-58135649177d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:35.026086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32852db7-cc2b-4b3c-b223-58135649177d service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:35.045271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 717/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:35.837186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b20c-b5c3-4b8a-ad18-f0199842d1c7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:35.838102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b20c-b5c3-4b8a-ad18-f0199842d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:35.838102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314b20c-b5c3-4b8a-ad18-f0199842d1c7 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:35.840338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:35.846449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574b43-acf8-4c9e-97b9-58d7c1479421 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:35.846927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574b43-acf8-4c9e-97b9-58d7c1479421 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:35.847311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574b43-acf8-4c9e-97b9-58d7c1479421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:35.926793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5b574b43-acf8-4c9e-97b9-58d7c1479421 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:35.927938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5b574b43-acf8-4c9e-97b9-58d7c1479421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:36.012800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:36.044466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:36.194978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b20c-b5c3-4b8a-ad18-f0199842d1c7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:36.196423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4314b20c-b5c3-4b8a-ad18-f0199842d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:36.215302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:36.361560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314b20c-b5c3-4b8a-ad18-f0199842d1c7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:36.455381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:36.494114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7e0b4-74ea-40f2-b0bf-f79bf2af07a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:36.494800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7e0b4-74ea-40f2-b0bf-f79bf2af07a5 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:36.495084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7e0b4-74ea-40f2-b0bf-f79bf2af07a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:36.495359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7e0b4-74ea-40f2-b0bf-f79bf2af07a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:36.497027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a6a7e0b4-74ea-40f2-b0bf-f79bf2af07a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:36.589913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7e0b4-74ea-40f2-b0bf-f79bf2af07a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:36.591583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7e0b4-74ea-40f2-b0bf-f79bf2af07a5 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:36.611582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 716/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:37.429020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f467c-0b91-4a95-b48d-d01014fc57ab None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:37.429600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f467c-0b91-4a95-b48d-d01014fc57ab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:37.429600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f467c-0b91-4a95-b48d-d01014fc57ab None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:37.431574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:37.436787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc834a7-ccf9-4f8e-94d5-989923f58aa3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:37.437252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc834a7-ccf9-4f8e-94d5-989923f58aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:37.437364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc834a7-ccf9-4f8e-94d5-989923f58aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:37.514692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8bc834a7-ccf9-4f8e-94d5-989923f58aa3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:37.515907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8bc834a7-ccf9-4f8e-94d5-989923f58aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:37.560740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:37.620353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:37.772991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f467c-0b91-4a95-b48d-d01014fc57ab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:37.775109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ff5f467c-0b91-4a95-b48d-d01014fc57ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:37.939992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f467c-0b91-4a95-b48d-d01014fc57ab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:38.000504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:38.061634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132a988-ee06-4ed1-977b-19d812ffd3a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:38.062328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a988-ee06-4ed1-977b-19d812ffd3a7 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:38.062605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a988-ee06-4ed1-977b-19d812ffd3a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:38.062874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132a988-ee06-4ed1-977b-19d812ffd3a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:38.064510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6132a988-ee06-4ed1-977b-19d812ffd3a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:38.183420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a988-ee06-4ed1-977b-19d812ffd3a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:38.185960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132a988-ee06-4ed1-977b-19d812ffd3a7 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:38.213949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 720/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:39.032384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6d8fe-178e-42f3-bb16-72794c1a2aa5 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:39.033212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6d8fe-178e-42f3-bb16-72794c1a2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:39.033212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6d8fe-178e-42f3-bb16-72794c1a2aa5 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:39.034838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:20:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:39.040223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66261e25-60c1-4db1-9490-2e8bbf420379 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:39.040666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66261e25-60c1-4db1-9490-2e8bbf420379 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:39.040778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66261e25-60c1-4db1-9490-2e8bbf420379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:39.121622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-66261e25-60c1-4db1-9490-2e8bbf420379 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:39.123060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-66261e25-60c1-4db1-9490-2e8bbf420379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:39.125339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:39.235216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:39.389791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6d8fe-178e-42f3-bb16-72794c1a2aa5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:39.392313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-92c6d8fe-178e-42f3-bb16-72794c1a2aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:39.564793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6d8fe-178e-42f3-bb16-72794c1a2aa5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:39.599481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:39.712023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5a0a0-ea86-4122-a70e-b78c1e976600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:39.712591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a0a0-ea86-4122-a70e-b78c1e976600 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:39.712871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a0a0-ea86-4122-a70e-b78c1e976600 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:39.713152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5a0a0-ea86-4122-a70e-b78c1e976600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:39.714887 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7e5a0a0-ea86-4122-a70e-b78c1e976600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:39.812679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5a0a0-ea86-4122-a70e-b78c1e976600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:39.814576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5a0a0-ea86-4122-a70e-b78c1e976600 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:39.834871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 719/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:41.797405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac82fd-2a50-4771-b77b-c3ddf067e13d None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:41.798267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac82fd-2a50-4771-b77b-c3ddf067e13d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:41.798267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac82fd-2a50-4771-b77b-c3ddf067e13d None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:41.800342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:41.806782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31680-49ab-43a9-85df-efaa48db9fed None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:41.807256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31680-49ab-43a9-85df-efaa48db9fed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:41.807363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a31680-49ab-43a9-85df-efaa48db9fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:41.851841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:41.886892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-35a31680-49ab-43a9-85df-efaa48db9fed None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:41.888116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-35a31680-49ab-43a9-85df-efaa48db9fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:41.992523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:42.033110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac82fd-2a50-4771-b77b-c3ddf067e13d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:42.035158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-feac82fd-2a50-4771-b77b-c3ddf067e13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:42.150072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac82fd-2a50-4771-b77b-c3ddf067e13d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:42.184201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:42.229397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f51e4-7fdf-47dc-9128-729041b75bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:42.230054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f51e4-7fdf-47dc-9128-729041b75bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:42.230335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f51e4-7fdf-47dc-9128-729041b75bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:42.230632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f51e4-7fdf-47dc-9128-729041b75bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:42.232265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a03f51e4-7fdf-47dc-9128-729041b75bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:42.349268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f51e4-7fdf-47dc-9128-729041b75bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:42.350752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f51e4-7fdf-47dc-9128-729041b75bbb service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:42.369475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 723/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:44.556434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e62b-8321-4bff-99de-72cf6fd57a0a None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:44.557068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e62b-8321-4bff-99de-72cf6fd57a0a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:44.557068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954e62b-8321-4bff-99de-72cf6fd57a0a None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:44.558505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:44.565146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67917-0bb5-4d96-a52a-f4a10cbda16a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:44.565817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67917-0bb5-4d96-a52a-f4a10cbda16a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:44.566325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67917-0bb5-4d96-a52a-f4a10cbda16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:44.644940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-67f67917-0bb5-4d96-a52a-f4a10cbda16a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:44.646145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-67f67917-0bb5-4d96-a52a-f4a10cbda16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:44.659492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:44.754123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:44.792817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e62b-8321-4bff-99de-72cf6fd57a0a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:44.795182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a954e62b-8321-4bff-99de-72cf6fd57a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:45.034587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954e62b-8321-4bff-99de-72cf6fd57a0a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:45.047941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:45.116472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e560e-8753-4586-bac8-f5ebb160b833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:45.117145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e560e-8753-4586-bac8-f5ebb160b833 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:45.117457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e560e-8753-4586-bac8-f5ebb160b833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:45.117730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e560e-8753-4586-bac8-f5ebb160b833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:45.119431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ee2e560e-8753-4586-bac8-f5ebb160b833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:45.233207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e560e-8753-4586-bac8-f5ebb160b833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:45.234706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e560e-8753-4586-bac8-f5ebb160b833 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:45.256400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 722/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:47.720047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dea2c-e7a6-4cd3-8814-7410dc319c25 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:47.720931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dea2c-e7a6-4cd3-8814-7410dc319c25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:47.720931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dea2c-e7a6-4cd3-8814-7410dc319c25 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:47.723365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:47.729667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07b7e-df1e-4949-8ee6-18c7a8967ce4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:47.730475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07b7e-df1e-4949-8ee6-18c7a8967ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:47.730583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f07b7e-df1e-4949-8ee6-18c7a8967ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:47.786850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:47.806854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-87f07b7e-df1e-4949-8ee6-18c7a8967ce4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:47.808116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-87f07b7e-df1e-4949-8ee6-18c7a8967ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:47.919437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:47.959377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dea2c-e7a6-4cd3-8814-7410dc319c25 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:47.961762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-098dea2c-e7a6-4cd3-8814-7410dc319c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:48.082774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dea2c-e7a6-4cd3-8814-7410dc319c25 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:48.129374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:48.166509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df85d14-db8a-4136-83ca-2c87a4596327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:48.167172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85d14-db8a-4136-83ca-2c87a4596327 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:48.167587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85d14-db8a-4136-83ca-2c87a4596327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:48.167723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df85d14-db8a-4136-83ca-2c87a4596327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:48.169359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7df85d14-db8a-4136-83ca-2c87a4596327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:48.284968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85d14-db8a-4136-83ca-2c87a4596327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:48.286332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df85d14-db8a-4136-83ca-2c87a4596327 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:48.304955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 726/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:50.528272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c996826-3fc4-437a-bbaf-12b9287d5c20 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:50.529203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c996826-3fc4-437a-bbaf-12b9287d5c20 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:50.529203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c996826-3fc4-437a-bbaf-12b9287d5c20 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:50.531329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:50.538214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e4a7-81bd-45d6-a780-28ef8cbca499 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:50.538707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e4a7-81bd-45d6-a780-28ef8cbca499 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:50.538830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e4a7-81bd-45d6-a780-28ef8cbca499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:50.611064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c3a8e4a7-81bd-45d6-a780-28ef8cbca499 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:50.612684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c3a8e4a7-81bd-45d6-a780-28ef8cbca499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:50.634461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:50.722119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:50.764415 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c996826-3fc4-437a-bbaf-12b9287d5c20 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:50.765969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c996826-3fc4-437a-bbaf-12b9287d5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:50.884214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c996826-3fc4-437a-bbaf-12b9287d5c20 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:50.910135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:50.972424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0336-1eb7-45b8-bdbf-aca12649910e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:50.973082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0336-1eb7-45b8-bdbf-aca12649910e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:50.973356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0336-1eb7-45b8-bdbf-aca12649910e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:50.973619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0336-1eb7-45b8-bdbf-aca12649910e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:50.975304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8a4c0336-1eb7-45b8-bdbf-aca12649910e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:51.097872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0336-1eb7-45b8-bdbf-aca12649910e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:51.099359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0336-1eb7-45b8-bdbf-aca12649910e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:51.119083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 725/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:53.334349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f045548-875c-48dc-9918-08705239b0a8 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:53.334922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f045548-875c-48dc-9918-08705239b0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:53.334922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f045548-875c-48dc-9918-08705239b0a8 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:53.336333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:53.342853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e51472-8578-4bfe-b751-992c769b0108 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:53.343580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e51472-8578-4bfe-b751-992c769b0108 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:53.343767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e51472-8578-4bfe-b751-992c769b0108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:53.411967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:53.415606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d4e51472-8578-4bfe-b751-992c769b0108 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:53.418339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d4e51472-8578-4bfe-b751-992c769b0108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:53.524180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:53.571932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f045548-875c-48dc-9918-08705239b0a8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:53.573471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6f045548-875c-48dc-9918-08705239b0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:53.683208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f045548-875c-48dc-9918-08705239b0a8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:53.737418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:53.764297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99258b-0f3c-4942-a085-618bb10f7aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:53.764954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99258b-0f3c-4942-a085-618bb10f7aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:53.765234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99258b-0f3c-4942-a085-618bb10f7aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:53.765503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99258b-0f3c-4942-a085-618bb10f7aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:53.767185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f99258b-0f3c-4942-a085-618bb10f7aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:53.903084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99258b-0f3c-4942-a085-618bb10f7aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:53.905193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99258b-0f3c-4942-a085-618bb10f7aa5 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:53.926615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 729/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:56.039278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc245ff-8d3f-421d-86f4-a1f2c8d228d3 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:56.039729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc245ff-8d3f-421d-86f4-a1f2c8d228d3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:56.039843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc245ff-8d3f-421d-86f4-a1f2c8d228d3 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:56.041192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:56.046623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6962-07b9-46e1-ad9a-675c19f7e382 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:56.047068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6962-07b9-46e1-ad9a-675c19f7e382 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:56.047177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f6962-07b9-46e1-ad9a-675c19f7e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:56.115255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-454f6962-07b9-46e1-ad9a-675c19f7e382 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:56.116484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-454f6962-07b9-46e1-ad9a-675c19f7e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:56.147794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:56.220060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:56.262532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc245ff-8d3f-421d-86f4-a1f2c8d228d3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:56.264092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4fc245ff-8d3f-421d-86f4-a1f2c8d228d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:56.386534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc245ff-8d3f-421d-86f4-a1f2c8d228d3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:56.415615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:56.463436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2209e33-6bcd-4cde-a6e3-e0fddfb26a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:56.464761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2209e33-6bcd-4cde-a6e3-e0fddfb26a42 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:56.465484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2209e33-6bcd-4cde-a6e3-e0fddfb26a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:56.466048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2209e33-6bcd-4cde-a6e3-e0fddfb26a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:56.470125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c2209e33-6bcd-4cde-a6e3-e0fddfb26a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:56.616583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2209e33-6bcd-4cde-a6e3-e0fddfb26a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:56.618038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2209e33-6bcd-4cde-a6e3-e0fddfb26a42 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:56.644416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 728/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:20:58.976971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc476c5-0a07-46a1-88e6-39f2d210d8ee None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:58.977531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc476c5-0a07-46a1-88e6-39f2d210d8ee None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:58.977531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc476c5-0a07-46a1-88e6-39f2d210d8ee None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:58.978871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:20:58.984200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c50a0-f2e1-4b34-8369-d759e0c0965e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:58.984669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c50a0-f2e1-4b34-8369-d759e0c0965e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:58.984802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c50a0-f2e1-4b34-8369-d759e0c0965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:59.052783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-601c50a0-f2e1-4b34-8369-d759e0c0965e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:20:59.054890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-601c50a0-f2e1-4b34-8369-d759e0c0965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:59.070687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:59.208113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:20:59.247723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc476c5-0a07-46a1-88e6-39f2d210d8ee None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:20:59.249271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bc476c5-0a07-46a1-88e6-39f2d210d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:59.387904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc476c5-0a07-46a1-88e6-39f2d210d8ee None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:20:59.449729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:20:59.472144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1fff7-e19c-41eb-b67d-e186c2e6ca3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:20:59.472809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fff7-e19c-41eb-b67d-e186c2e6ca3c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:20:59.473091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fff7-e19c-41eb-b67d-e186c2e6ca3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:20:59.473363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fff7-e19c-41eb-b67d-e186c2e6ca3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:20:59.475089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5eb1fff7-e19c-41eb-b67d-e186c2e6ca3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:20:59.608146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1fff7-e19c-41eb-b67d-e186c2e6ca3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:20:59.609601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1fff7-e19c-41eb-b67d-e186c2e6ca3c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:20:59.629406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 732/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:01.770800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde909d-6d52-43bd-899c-fa912bbafe0b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:01.771389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde909d-6d52-43bd-899c-fa912bbafe0b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:01.771389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde909d-6d52-43bd-899c-fa912bbafe0b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:01.772720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:01.778999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bd982-a2ee-4b2b-b7cd-238b765a0d53 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:01.779457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bd982-a2ee-4b2b-b7cd-238b765a0d53 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:01.779561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bd982-a2ee-4b2b-b7cd-238b765a0d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:01.854620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-185bd982-a2ee-4b2b-b7cd-238b765a0d53 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:01.855719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-185bd982-a2ee-4b2b-b7cd-238b765a0d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:01.898242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:01.962929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:02.011038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde909d-6d52-43bd-899c-fa912bbafe0b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:02.012629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-afde909d-6d52-43bd-899c-fa912bbafe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:02.128508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde909d-6d52-43bd-899c-fa912bbafe0b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:02.174908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:02.214927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc39faf-3e4f-4c81-8797-a85b5ecbf544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:02.215588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39faf-3e4f-4c81-8797-a85b5ecbf544 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:02.215862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39faf-3e4f-4c81-8797-a85b5ecbf544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:02.216129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc39faf-3e4f-4c81-8797-a85b5ecbf544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:02.217777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2dc39faf-3e4f-4c81-8797-a85b5ecbf544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:02.336061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc39faf-3e4f-4c81-8797-a85b5ecbf544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:02.337495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc39faf-3e4f-4c81-8797-a85b5ecbf544 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:02.358455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 731/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:04.398160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5fb37-ebf2-4333-96ac-b66644e4a326 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:04.398861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5fb37-ebf2-4333-96ac-b66644e4a326 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:04.398861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5fb37-ebf2-4333-96ac-b66644e4a326 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:04.400145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:04.406537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1130cd-1d38-4dbd-9bd5-abd6381bf80a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:04.407022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1130cd-1d38-4dbd-9bd5-abd6381bf80a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:04.407126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1130cd-1d38-4dbd-9bd5-abd6381bf80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:04.476068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5b1130cd-1d38-4dbd-9bd5-abd6381bf80a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:04.477330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5b1130cd-1d38-4dbd-9bd5-abd6381bf80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:04.500381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:04.589940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:04.630186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5fb37-ebf2-4333-96ac-b66644e4a326 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:04.631787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46a5fb37-ebf2-4333-96ac-b66644e4a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:04.746242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5fb37-ebf2-4333-96ac-b66644e4a326 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:04.825166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:04.833218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5322f-705b-440f-aa25-08d6db45aeee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:04.833878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5322f-705b-440f-aa25-08d6db45aeee service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:04.834161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5322f-705b-440f-aa25-08d6db45aeee service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:04.834493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5322f-705b-440f-aa25-08d6db45aeee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:04.836143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ee5322f-705b-440f-aa25-08d6db45aeee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:04.960351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5322f-705b-440f-aa25-08d6db45aeee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:04.961788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5322f-705b-440f-aa25-08d6db45aeee service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:04.981321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 735/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:07.097391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563022-d936-4f0c-a432-996a04b76238 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:07.098184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563022-d936-4f0c-a432-996a04b76238 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:07.098184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19563022-d936-4f0c-a432-996a04b76238 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:07.100322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:21:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:07.105974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b506f-1873-4c12-a852-9db8025a9020 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:07.106446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b506f-1873-4c12-a852-9db8025a9020 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:07.106552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b506f-1873-4c12-a852-9db8025a9020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:07.176311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e67b506f-1873-4c12-a852-9db8025a9020 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:07.177526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e67b506f-1873-4c12-a852-9db8025a9020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:07.225578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:07.278742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:07.318075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19563022-d936-4f0c-a432-996a04b76238 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:07.320459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-19563022-d936-4f0c-a432-996a04b76238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:07.442169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19563022-d936-4f0c-a432-996a04b76238 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:07.493905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:07.525473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6bc47-648b-4779-9086-6695b17df096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:07.526151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6bc47-648b-4779-9086-6695b17df096 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:07.526451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6bc47-648b-4779-9086-6695b17df096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:07.526718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6bc47-648b-4779-9086-6695b17df096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:07.528448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7ff6bc47-648b-4779-9086-6695b17df096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:07.668107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6bc47-648b-4779-9086-6695b17df096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:07.669566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6bc47-648b-4779-9086-6695b17df096 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:07.689980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 734/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:17.276673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=22 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:17.687506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=66 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:27.527444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf90a6-7542-44f2-976d-2eaf56fe1865 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:27.528364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf90a6-7542-44f2-976d-2eaf56fe1865 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:27.528364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf90a6-7542-44f2-976d-2eaf56fe1865 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:27.530608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 737/1471] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:21:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:27.537617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700e78-75f8-418b-9306-876a41ab3501 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:27.538081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700e78-75f8-418b-9306-876a41ab3501 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:27.538190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c700e78-75f8-418b-9306-876a41ab3501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:27.606116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2c700e78-75f8-418b-9306-876a41ab3501 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:27.607361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c700e78-75f8-418b-9306-876a41ab3501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:27.723489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 735/1472] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:27.814673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916f46-a2f7-4c26-9827-8407111f3719 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:27.815008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916f46-a2f7-4c26-9827-8407111f3719 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:27.815637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916f46-a2f7-4c26-9827-8407111f3719 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:27.816911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 738/1473] 10.222.0.50 () {54 vars in 962 bytes} [Tue Jul 12 17:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:27.822116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cbeea-3244-454e-b20e-97fbfb824c3e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:27.822486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cbeea-3244-454e-b20e-97fbfb824c3e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:27.822761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cbeea-3244-454e-b20e-97fbfb824c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:27.901072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f1cbeea-3244-454e-b20e-97fbfb824c3e None None] MFA Rules not processed for user `7724df01ff1444a09a751bb54dabc222`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:27.902315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f1cbeea-3244-454e-b20e-97fbfb824c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:27.923661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:27.984173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 736/1474] 10.222.0.50 () {58 vars in 1059 bytes} [Tue Jul 12 17:21:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:21:27.992880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc916f46-a2f7-4c26-9827-8407111f3719 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:27.994439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dc916f46-a2f7-4c26-9827-8407111f3719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:28.107139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc916f46-a2f7-4c26-9827-8407111f3719 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:28.195607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df7fa3-e59e-49b6-808f-1115894c8390 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:28.196259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df7fa3-e59e-49b6-808f-1115894c8390 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:28.196539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df7fa3-e59e-49b6-808f-1115894c8390 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:28.196804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df7fa3-e59e-49b6-808f-1115894c8390 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:28.198489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d8df7fa3-e59e-49b6-808f-1115894c8390 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:28.255719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:28.318242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df7fa3-e59e-49b6-808f-1115894c8390 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:28.319731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df7fa3-e59e-49b6-808f-1115894c8390 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:28.342380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 739/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:30.535880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7eae2-91ec-4b80-9b6e-fa2c28a6f5fb None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:30.536478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7eae2-91ec-4b80-9b6e-fa2c28a6f5fb None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:30.536478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7eae2-91ec-4b80-9b6e-fa2c28a6f5fb None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:30.538474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 737/1476] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:21:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:30.543916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb0409-652a-4fac-a735-9f2f68f166b6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:30.544370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb0409-652a-4fac-a735-9f2f68f166b6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:30.544468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb0409-652a-4fac-a735-9f2f68f166b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:30.616695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-10bb0409-652a-4fac-a735-9f2f68f166b6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:30.617903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-10bb0409-652a-4fac-a735-9f2f68f166b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:30.716875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 740/1477] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:30.741277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7eae2-91ec-4b80-9b6e-fa2c28a6f5fb None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:30.742861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6cb7eae2-91ec-4b80-9b6e-fa2c28a6f5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:30.890514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7eae2-91ec-4b80-9b6e-fa2c28a6f5fb None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:30.944468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:30.991806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38612f-76fe-453f-9d59-7ece8ea5058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:30.992467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38612f-76fe-453f-9d59-7ece8ea5058f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:30.992738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38612f-76fe-453f-9d59-7ece8ea5058f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:30.993005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38612f-76fe-453f-9d59-7ece8ea5058f admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:30.993744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38612f-76fe-453f-9d59-7ece8ea5058f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:30.995573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-ef38612f-76fe-453f-9d59-7ece8ea5058f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:21:30.995573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:21:30.995573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:21:30.996709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38612f-76fe-453f-9d59-7ece8ea5058f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:31.016017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 738/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Tue Jul 12 17:21:30 2022] GET /identity/v3/projects => generated 2553 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:21:33.141390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f93d9a-c96f-49a3-a1fa-d726877c6c4f None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:33.142349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f93d9a-c96f-49a3-a1fa-d726877c6c4f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:33.142349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f93d9a-c96f-49a3-a1fa-d726877c6c4f None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:33.144820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 741/1479] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:21:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:33.150355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64684c-127e-4541-87de-765d1bb46ce6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:33.150810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64684c-127e-4541-87de-765d1bb46ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:33.150928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64684c-127e-4541-87de-765d1bb46ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:33.225695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2f64684c-127e-4541-87de-765d1bb46ce6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:33.226929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2f64684c-127e-4541-87de-765d1bb46ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:33.332442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 739/1480] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:33.379934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f93d9a-c96f-49a3-a1fa-d726877c6c4f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:33.381475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d3f93d9a-c96f-49a3-a1fa-d726877c6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:33.394848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:33.540125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f93d9a-c96f-49a3-a1fa-d726877c6c4f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:33.637345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:33.673582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69afdf08-c077-4455-bee5-b97af9a3fff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:33.674174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afdf08-c077-4455-bee5-b97af9a3fff5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:33.674486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afdf08-c077-4455-bee5-b97af9a3fff5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:33.674767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afdf08-c077-4455-bee5-b97af9a3fff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:33.676727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-69afdf08-c077-4455-bee5-b97af9a3fff5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:33.772968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afdf08-c077-4455-bee5-b97af9a3fff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:33.774618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69afdf08-c077-4455-bee5-b97af9a3fff5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:33.793264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 742/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:36.064617 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4371b-5fa3-4d07-90c8-a15d0d7322b4 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:36.065128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4371b-5fa3-4d07-90c8-a15d0d7322b4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:36.065128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc4371b-5fa3-4d07-90c8-a15d0d7322b4 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:36.067250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 740/1482] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:36.072795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a166e-1a06-4015-817c-75600a744b5f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:36.073268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a166e-1a06-4015-817c-75600a744b5f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:36.073386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a166e-1a06-4015-817c-75600a744b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:36.148211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-4b2a166e-1a06-4015-817c-75600a744b5f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:36.149440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b2a166e-1a06-4015-817c-75600a744b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:36.325527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:36.381332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 743/1483] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:36.423239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4371b-5fa3-4d07-90c8-a15d0d7322b4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:36.424799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cfc4371b-5fa3-4d07-90c8-a15d0d7322b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:36.452179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:36.537034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc4371b-5fa3-4d07-90c8-a15d0d7322b4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:36.621100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cfb52-dc3d-4d1d-9276-f9692849c8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:36.621786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cfb52-dc3d-4d1d-9276-f9692849c8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:36.622068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cfb52-dc3d-4d1d-9276-f9692849c8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:36.622316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cfb52-dc3d-4d1d-9276-f9692849c8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:36.623986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-153cfb52-dc3d-4d1d-9276-f9692849c8c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:36.705118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:36.744790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cfb52-dc3d-4d1d-9276-f9692849c8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:36.746275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cfb52-dc3d-4d1d-9276-f9692849c8c1 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:36.767750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 741/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:38.863412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553231b-b5c5-41d3-9dbf-8ade129b46c5 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:38.863987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553231b-b5c5-41d3-9dbf-8ade129b46c5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:38.864084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553231b-b5c5-41d3-9dbf-8ade129b46c5 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:38.866281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 744/1485] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:38.875306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdaad9-af49-4994-98a7-0171e4795e83 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:38.875803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdaad9-af49-4994-98a7-0171e4795e83 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:38.875907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdaad9-af49-4994-98a7-0171e4795e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:38.949253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b5bdaad9-af49-4994-98a7-0171e4795e83 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:38.950511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5bdaad9-af49-4994-98a7-0171e4795e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:39.053496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 742/1486] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:39.094729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553231b-b5c5-41d3-9dbf-8ade129b46c5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:39.096792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5553231b-b5c5-41d3-9dbf-8ade129b46c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:39.207277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553231b-b5c5-41d3-9dbf-8ade129b46c5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:39.290911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:39.292826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a225877-b9b9-494a-9d8f-df18b199902c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:39.293552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225877-b9b9-494a-9d8f-df18b199902c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:39.293829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225877-b9b9-494a-9d8f-df18b199902c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:39.294143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a225877-b9b9-494a-9d8f-df18b199902c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:39.296618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a225877-b9b9-494a-9d8f-df18b199902c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:39.413554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a225877-b9b9-494a-9d8f-df18b199902c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:39.415011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a225877-b9b9-494a-9d8f-df18b199902c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:39.433576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 745/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:41.612666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868043bb-ddea-4eec-a804-262f459e4d85 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:41.613231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868043bb-ddea-4eec-a804-262f459e4d85 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:41.613672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868043bb-ddea-4eec-a804-262f459e4d85 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:41.615786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 743/1488] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:21:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:41.622238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f8849-3f2b-4909-b0af-4c43ecd10500 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:41.622844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f8849-3f2b-4909-b0af-4c43ecd10500 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:41.622844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f8849-3f2b-4909-b0af-4c43ecd10500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:41.697659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-726f8849-3f2b-4909-b0af-4c43ecd10500 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:41.699373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-726f8849-3f2b-4909-b0af-4c43ecd10500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:41.759303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:41.816956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 746/1489] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:21:41.872618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868043bb-ddea-4eec-a804-262f459e4d85 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:41.875173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-868043bb-ddea-4eec-a804-262f459e4d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:41.922019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:42.022683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868043bb-ddea-4eec-a804-262f459e4d85 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:42.109130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050d13c-ab2a-4162-98ee-6025e85e1d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:42.109799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050d13c-ab2a-4162-98ee-6025e85e1d7b service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:42.110079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050d13c-ab2a-4162-98ee-6025e85e1d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:42.110388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050d13c-ab2a-4162-98ee-6025e85e1d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:42.112416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4050d13c-ab2a-4162-98ee-6025e85e1d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:42.194333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:42.225514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050d13c-ab2a-4162-98ee-6025e85e1d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:42.227010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050d13c-ab2a-4162-98ee-6025e85e1d7b service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:42.250308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 744/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:44.473925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179966-7c86-47cf-bbf0-335388cb6bbb None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:44.474485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179966-7c86-47cf-bbf0-335388cb6bbb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:44.474485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b179966-7c86-47cf-bbf0-335388cb6bbb None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:44.475811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 747/1491] 10.222.0.50 () {54 vars in 926 bytes} [Tue Jul 12 17:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:21:44.482143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95eac4-b7be-4549-bb08-d6dceb03026d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:44.482839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95eac4-b7be-4549-bb08-d6dceb03026d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:44.482955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95eac4-b7be-4549-bb08-d6dceb03026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:44.560672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2b95eac4-b7be-4549-bb08-d6dceb03026d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:21:44.561922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2b95eac4-b7be-4549-bb08-d6dceb03026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:44.663478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 745/1492] 10.222.0.50 () {58 vars in 1023 bytes} [Tue Jul 12 17:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:21:44.705901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b179966-7c86-47cf-bbf0-335388cb6bbb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:21:44.707957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b179966-7c86-47cf-bbf0-335388cb6bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:44.816978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b179966-7c86-47cf-bbf0-335388cb6bbb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:21:44.892271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c27e3-3c6b-4939-8651-f8c59cdba780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:21:44.892920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c27e3-3c6b-4939-8651-f8c59cdba780 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:21:44.893194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c27e3-3c6b-4939-8651-f8c59cdba780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:21:44.893456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c27e3-3c6b-4939-8651-f8c59cdba780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:21:44.895283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f07c27e3-3c6b-4939-8651-f8c59cdba780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:21:44.904461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:45.023822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c27e3-3c6b-4939-8651-f8c59cdba780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:21:45.025185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c27e3-3c6b-4939-8651-f8c59cdba780 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:21:45.045259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 748/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:21:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:21:54.661383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=82 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:21:55.042391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=50 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:12.102365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:12.102941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:12.102941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:12.196230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:23:12.197440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:12.318567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 746/1494] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:23:12.330450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d023f2-2993-4218-9933-f5302c411be0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:12.330950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d023f2-2993-4218-9933-f5302c411be0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:12.331053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d023f2-2993-4218-9933-f5302c411be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:12.412899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-33d023f2-2993-4218-9933-f5302c411be0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:23:12.414465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33d023f2-2993-4218-9933-f5302c411be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:12.526669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 749/1495] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:23:12.531556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:12.532795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:12.545906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbde27-12d3-4393-81a8-b0a726c35be9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:12.612631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:12.649431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:12.650111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:12.650442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:12.650722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:12.651449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:23:12.651757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:12.652789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:12.652789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:23:12.652789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:23:12.653684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:12.665995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 747/1496] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:23:12.674482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d023f2-2993-4218-9933-f5302c411be0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:12.683961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d023f2-2993-4218-9933-f5302c411be0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:12.749934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:12.786159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:12.786926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:12.787209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:12.787482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:12.788177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:12.789951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:12.789951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 12 17:23:12.789951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: Jul 12 17:23:12.791171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:12.861042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 750/1497] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:23:12 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:23:12.865827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:12.867459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:12.903468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322081b-cb17-488a-85d0-aa0f3abf6cd9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:13.025179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:13.025869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:13.026154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:13.026484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:13.027148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:13.028185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:13.028185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:23:13.028185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:23:13.029406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:13.073880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 748/1498] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:23:12 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:23:13.078309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:13.079903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:13.146936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e5240-400e-4f83-bdf6-a0095d1373ab admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:13.234530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:13.246557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:13.247253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:13.247507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:13.247778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:13.248505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:13.249520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:13.249520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 12 17:23:13.249520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: Jul 12 17:23:13.250429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:13.262872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 751/1499] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:23:13.267220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:13.268767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:13.280787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba245373-fbe0-4fe2-a7f7-bf7f8e1a29f4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:13.307013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:13.387063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eab5bc-3122-44bc-9a70-59ddf20d00de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:13.387747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab5bc-3122-44bc-9a70-59ddf20d00de admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:13.388019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab5bc-3122-44bc-9a70-59ddf20d00de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:13.388292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eab5bc-3122-44bc-9a70-59ddf20d00de admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:13.389027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab5bc-3122-44bc-9a70-59ddf20d00de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:13.390060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-a1eab5bc-3122-44bc-9a70-59ddf20d00de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:13.390060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:23:13.390060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:23:13.391007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eab5bc-3122-44bc-9a70-59ddf20d00de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:13.404211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 749/1500] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:23:13.408751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:13.410330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:13.446603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6a30-3e5e-4be7-9645-38daa44dfcfa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:13.543969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e2c21-912d-4887-ad1f-bcb154411c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:13.544875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e2c21-912d-4887-ad1f-bcb154411c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:13.545154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e2c21-912d-4887-ad1f-bcb154411c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:13.545429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e2c21-912d-4887-ad1f-bcb154411c2a admin admin] PATH_INFO: `/v3/projects/c8b3b8eafdbf4ae28e6b24049bb54ef7/users/bc2a7d32433842998dd6db0e04fe015d/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:13.569441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e2c21-912d-4887-ad1f-bcb154411c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b3b8eafdbf4ae28e6b24049bb54ef7, user_id=bc2a7d32433842998dd6db0e04fe015d, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:13.570503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-d48e2c21-912d-4887-ad1f-bcb154411c2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:13.570503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 12 17:23:13.570503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: Jul 12 17:23:13.572449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e2c21-912d-4887-ad1f-bcb154411c2a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:13.606908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 752/1501] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:23:13 2022] PUT /identity/v3/projects/c8b3b8eafdbf4ae28e6b24049bb54ef7/users/bc2a7d32433842998dd6db0e04fe015d/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:23:13.619897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618b57-bc08-4531-bfef-b713e7d20f82 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:13.620218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618b57-bc08-4531-bfef-b713e7d20f82 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:13.620495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78618b57-bc08-4531-bfef-b713e7d20f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:13.683046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-78618b57-bc08-4531-bfef-b713e7d20f82 None None] MFA Rules not processed for user `bc2a7d32433842998dd6db0e04fe015d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:23:13.684206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-78618b57-bc08-4531-bfef-b713e7d20f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:13.772401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 750/1502] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:23:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:23:13.786450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a159-2257-4bb3-afad-f1685004400a None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:13.786877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a159-2257-4bb3-afad-f1685004400a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:13.787186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3a159-2257-4bb3-afad-f1685004400a None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:13.788602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 753/1503] 10.222.0.50 () {54 vars in 963 bytes} [Tue Jul 12 17:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:23:13.793698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180495-51c7-45df-afb9-6c5b0ae6c649 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:13.793986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180495-51c7-45df-afb9-6c5b0ae6c649 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:13.794252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180495-51c7-45df-afb9-6c5b0ae6c649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:13.826570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:13.880903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-49180495-51c7-45df-afb9-6c5b0ae6c649 None None] MFA Rules not processed for user `c30dd51dbbb245a485be48fce34295e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:23:13.882159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-49180495-51c7-45df-afb9-6c5b0ae6c649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:13.975553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 751/1504] 10.222.0.50 () {58 vars in 1060 bytes} [Tue Jul 12 17:23:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:23:13.983473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a159-2257-4bb3-afad-f1685004400a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:13.985415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8a3a159-2257-4bb3-afad-f1685004400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:14.039393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:14.097524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3a159-2257-4bb3-afad-f1685004400a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:14.174938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:14.175599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:14.175883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:14.176159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:14.178105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:14.303896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:14.305245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:14.308709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:14.323657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 754/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:23:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:23:14.366541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624ffc0-d1ef-432d-8664-8ad8cc397628 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:14.367003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624ffc0-d1ef-432d-8664-8ad8cc397628 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:14.367100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624ffc0-d1ef-432d-8664-8ad8cc397628 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:14.368460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 752/1506] 10.222.0.50 () {52 vars in 829 bytes} [Tue Jul 12 17:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:23:14.373084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:14.374350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:14.489510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5aaff-0cfe-4d23-8b24-558c1f82a4ed service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:14.589307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:14.590199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:14.590508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:14.590777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] PATH_INFO: `/v3/users/bc2a7d32433842998dd6db0e04fe015d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:14.606553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2a7d32433842998dd6db0e04fe015d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:14.607854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:14.607854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 12 17:23:14.607854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: Jul 12 17:23:14.609436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:14.621650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:14.679261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2a7d32433842998dd6db0e04fe015d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:14.693077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2a7d32433842998dd6db0e04fe015d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:14.712157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2a7d32433842998dd6db0e04fe015d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:14.724861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2a7d32433842998dd6db0e04fe015d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:14.725314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2a7d32433842998dd6db0e04fe015d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:14.731313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 755/1507] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:23:14 2022] DELETE /identity/v3/users/bc2a7d32433842998dd6db0e04fe015d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:23:14.736251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:14.736542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:14.736816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:14.794403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:23:14.795626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:14.888144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:14.903908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 753/1508] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:23:14.915713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:14.916996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:15.026569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66f077-bc57-4ded-8677-9f5b7c6a9580 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:15.091752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:15.123075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de733bf-6657-4d23-8a60-2cef9990871a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:15.123743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de733bf-6657-4d23-8a60-2cef9990871a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:15.124029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de733bf-6657-4d23-8a60-2cef9990871a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:15.124351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de733bf-6657-4d23-8a60-2cef9990871a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:15.126011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0de733bf-6657-4d23-8a60-2cef9990871a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:15.249992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de733bf-6657-4d23-8a60-2cef9990871a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:15.251408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de733bf-6657-4d23-8a60-2cef9990871a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:15.270929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 756/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:23:15.643678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:23:15.644935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:23:15.656683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64391966-a11b-43bc-91b0-d5422bb79b0a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:23:15.759754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:23:15.760641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:23:15.760922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:23:15.761228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] PATH_INFO: `/v3/projects/c8b3b8eafdbf4ae28e6b24049bb54ef7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:23:15.771790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b3b8eafdbf4ae28e6b24049bb54ef7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:23:15.772776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:23:15.772776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:23:15.772776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:23:15.773997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:23:15.839228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b3b8eafdbf4ae28e6b24049bb54ef7', 'request_id': 'req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:15.847563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b3b8eafdbf4ae28e6b24049bb54ef7', 'request_id': 'req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:15.869022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b3b8eafdbf4ae28e6b24049bb54ef7', 'request_id': 'req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:15.902685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] The token cache is being invalidate because project c8b3b8eafdbf4ae28e6b24049bb54ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:23:15.902960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:15.903386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5738d87c-5bae-4a8c-b2e5-2b70d0d12b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:23:15.904868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 754/1510] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:23:15 2022] DELETE /identity/v3/projects/c8b3b8eafdbf4ae28e6b24049bb54ef7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:23:25.268289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=62 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:23:25.900771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:03.900068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486ded-c92e-4cd6-adbf-70081f1f2bda None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:03.900688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486ded-c92e-4cd6-adbf-70081f1f2bda None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:03.900688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486ded-c92e-4cd6-adbf-70081f1f2bda None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:03.901919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:25:03.907415 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d588-c49b-4d85-a6ff-b08785e29f49 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:03.907861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d588-c49b-4d85-a6ff-b08785e29f49 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:03.907962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943d588-c49b-4d85-a6ff-b08785e29f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:03.994108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c943d588-c49b-4d85-a6ff-b08785e29f49 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:03.995360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c943d588-c49b-4d85-a6ff-b08785e29f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:04.103680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:04.262602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486ded-c92e-4cd6-adbf-70081f1f2bda None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:04.266523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-77486ded-c92e-4cd6-adbf-70081f1f2bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:04.404623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486ded-c92e-4cd6-adbf-70081f1f2bda None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:04.411221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a7ce3-bd5e-4919-8470-0cbc2f387c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:04.411881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a7ce3-bd5e-4919-8470-0cbc2f387c94 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:04.412166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a7ce3-bd5e-4919-8470-0cbc2f387c94 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:04.412440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a7ce3-bd5e-4919-8470-0cbc2f387c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:04.421120 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a7ce3-bd5e-4919-8470-0cbc2f387c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:04.422758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a7ce3-bd5e-4919-8470-0cbc2f387c94 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:04.433090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 758/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:05.268362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a531ce-7c30-4005-8736-828849f69115 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:05.268987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a531ce-7c30-4005-8736-828849f69115 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:05.268987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a531ce-7c30-4005-8736-828849f69115 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:05.270785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:05.275946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882677-8930-47cc-b40c-42d97cdd1681 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:05.276428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882677-8930-47cc-b40c-42d97cdd1681 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:05.276587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d882677-8930-47cc-b40c-42d97cdd1681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:05.296287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5d882677-8930-47cc-b40c-42d97cdd1681 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:05.297477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d882677-8930-47cc-b40c-42d97cdd1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:05.307644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:05.420661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264fd3-c83d-4b78-bbe5-f0e5f5b7ebc7 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:05.421049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264fd3-c83d-4b78-bbe5-f0e5f5b7ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:05.421401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264fd3-c83d-4b78-bbe5-f0e5f5b7ebc7 None None] PATH_INFO: `/v3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:05.423002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 757/1516] 10.222.0.64 () {54 vars in 925 bytes} [Tue Jul 12 17:25:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:25:05.430893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f221-778e-49ef-a362-8a336794b1ca None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:05.431209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f221-778e-49ef-a362-8a336794b1ca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:05.431487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f221-778e-49ef-a362-8a336794b1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:05.464834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf264fd3-c83d-4b78-bbe5-f0e5f5b7ebc7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:05.480677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf264fd3-c83d-4b78-bbe5-f0e5f5b7ebc7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:05.486738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2e471-407f-4a8b-a0ef-4ba2f9200796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:05.487388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e471-407f-4a8b-a0ef-4ba2f9200796 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:05.487671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e471-407f-4a8b-a0ef-4ba2f9200796 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:05.487945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2e471-407f-4a8b-a0ef-4ba2f9200796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:05.495815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f312f221-778e-49ef-a362-8a336794b1ca None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:05.496741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2e471-407f-4a8b-a0ef-4ba2f9200796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:05.497044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f312f221-778e-49ef-a362-8a336794b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:05.498365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2e471-407f-4a8b-a0ef-4ba2f9200796 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:05.508555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 758/1517] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:25:05.556894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:05.577962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 760/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 12 17:25:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:15.503755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=75 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:15.574571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:15.636497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f0132-02f3-47fc-adf3-1defaeef302d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:15.636783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f0132-02f3-47fc-adf3-1defaeef302d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:15.637030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f0132-02f3-47fc-adf3-1defaeef302d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:15.638490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 759/1519] 10.222.0.50 () {54 vars in 960 bytes} [Tue Jul 12 17:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:15.644506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f400138-ef7a-4753-b491-09b4927d0363 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:15.644852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f400138-ef7a-4753-b491-09b4927d0363 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:15.645325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f400138-ef7a-4753-b491-09b4927d0363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:15.672655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1f400138-ef7a-4753-b491-09b4927d0363 None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:15.673884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f400138-ef7a-4753-b491-09b4927d0363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:15.686409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 761/1520] 10.222.0.50 () {58 vars in 1057 bytes} [Tue Jul 12 17:25:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:15.696660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f0132-02f3-47fc-adf3-1defaeef302d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:15.711805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f0132-02f3-47fc-adf3-1defaeef302d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:15.717260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e2cd0-7a9b-431c-a09e-f19d839def28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:15.717912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2cd0-7a9b-431c-a09e-f19d839def28 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:15.718183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2cd0-7a9b-431c-a09e-f19d839def28 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:15.718490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e2cd0-7a9b-431c-a09e-f19d839def28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:15.727611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e2cd0-7a9b-431c-a09e-f19d839def28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:15.729232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e2cd0-7a9b-431c-a09e-f19d839def28 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:15.740136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 760/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:16.727760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06bb79-def3-4f62-ae73-2767ed346a05 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:16.728619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06bb79-def3-4f62-ae73-2767ed346a05 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:16.728619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06bb79-def3-4f62-ae73-2767ed346a05 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:16.730824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:25:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:16.736800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f3b6-45fb-4154-a15b-6db39a5483fc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:16.737550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f3b6-45fb-4154-a15b-6db39a5483fc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:16.737713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f3b6-45fb-4154-a15b-6db39a5483fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:16.760128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-aab9f3b6-45fb-4154-a15b-6db39a5483fc None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:16.761344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aab9f3b6-45fb-4154-a15b-6db39a5483fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:16.770857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:16.929499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06bb79-def3-4f62-ae73-2767ed346a05 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:16.946031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06bb79-def3-4f62-ae73-2767ed346a05 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:16.952246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870c8c3-3ab4-448c-9bb8-d2699fc0b064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:16.952896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870c8c3-3ab4-448c-9bb8-d2699fc0b064 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:16.953210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870c8c3-3ab4-448c-9bb8-d2699fc0b064 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:16.953475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870c8c3-3ab4-448c-9bb8-d2699fc0b064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:16.963076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870c8c3-3ab4-448c-9bb8-d2699fc0b064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:16.964681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870c8c3-3ab4-448c-9bb8-d2699fc0b064 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:16.975309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 763/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:17.802027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351721a-d36e-42eb-bbe9-28a9fa23aacc None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:17.803196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351721a-d36e-42eb-bbe9-28a9fa23aacc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:17.803196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351721a-d36e-42eb-bbe9-28a9fa23aacc None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:17.805264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 17:25:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:17.813360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6021-84da-4c0c-a921-dcd3f81c9d01 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:17.813814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6021-84da-4c0c-a921-dcd3f81c9d01 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:17.813955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a6021-84da-4c0c-a921-dcd3f81c9d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:17.836023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a78a6021-84da-4c0c-a921-dcd3f81c9d01 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:17.837370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a78a6021-84da-4c0c-a921-dcd3f81c9d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:17.846451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 17:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:18.013260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351721a-d36e-42eb-bbe9-28a9fa23aacc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:18.037586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351721a-d36e-42eb-bbe9-28a9fa23aacc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:18.043822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba0370-beb3-4576-b54f-5e6249298493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:18.044499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0370-beb3-4576-b54f-5e6249298493 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:18.044783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0370-beb3-4576-b54f-5e6249298493 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:18.045063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba0370-beb3-4576-b54f-5e6249298493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:18.053910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba0370-beb3-4576-b54f-5e6249298493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:18.055589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba0370-beb3-4576-b54f-5e6249298493 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:18.066166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 763/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:22.142963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716483e5-06a1-49e0-84f4-2fe5004d6148 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:22.143871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716483e5-06a1-49e0-84f4-2fe5004d6148 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:22.143871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716483e5-06a1-49e0-84f4-2fe5004d6148 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:22.146110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:25:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:22.151832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c5cf7-d26d-44ee-8a78-4f4ef567eab9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:22.152289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c5cf7-d26d-44ee-8a78-4f4ef567eab9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:22.152399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c5cf7-d26d-44ee-8a78-4f4ef567eab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:22.172452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-064c5cf7-d26d-44ee-8a78-4f4ef567eab9 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:22.173642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-064c5cf7-d26d-44ee-8a78-4f4ef567eab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:22.182497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:22.260463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716483e5-06a1-49e0-84f4-2fe5004d6148 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:22.262964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-716483e5-06a1-49e0-84f4-2fe5004d6148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:22.358490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716483e5-06a1-49e0-84f4-2fe5004d6148 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:22.362706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29738b93-9248-4b55-8d4f-12bd42c0a0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:22.363364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29738b93-9248-4b55-8d4f-12bd42c0a0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:22.363692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29738b93-9248-4b55-8d4f-12bd42c0a0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:22.363974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29738b93-9248-4b55-8d4f-12bd42c0a0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:22.375403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29738b93-9248-4b55-8d4f-12bd42c0a0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:22.377523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29738b93-9248-4b55-8d4f-12bd42c0a0b6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:22.389871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 766/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:24.406951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5001-e6a4-4a8f-9e6d-68542c490778 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:24.407535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5001-e6a4-4a8f-9e6d-68542c490778 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:24.407535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a5001-e6a4-4a8f-9e6d-68542c490778 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:24.409733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:24.418921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c7b8-1475-4509-81c2-78c127cf5354 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:24.419349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c7b8-1475-4509-81c2-78c127cf5354 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:24.419519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4c7b8-1475-4509-81c2-78c127cf5354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:24.442963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6bf4c7b8-1475-4509-81c2-78c127cf5354 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:24.444213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bf4c7b8-1475-4509-81c2-78c127cf5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:24.454095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:24.494079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5001-e6a4-4a8f-9e6d-68542c490778 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:24.510731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a5001-e6a4-4a8f-9e6d-68542c490778 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:24.515410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1929465-0cbc-4f80-a34e-17cae822f98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:24.516057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929465-0cbc-4f80-a34e-17cae822f98d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:24.516341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929465-0cbc-4f80-a34e-17cae822f98d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:24.516612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929465-0cbc-4f80-a34e-17cae822f98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:24.526045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1929465-0cbc-4f80-a34e-17cae822f98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:24.527538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1929465-0cbc-4f80-a34e-17cae822f98d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:24.537007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 766/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:28.024104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805263e-35aa-4bea-9cf1-d5d2476c9089 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:28.024971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805263e-35aa-4bea-9cf1-d5d2476c9089 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:28.024971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805263e-35aa-4bea-9cf1-d5d2476c9089 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:28.027013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:25:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:28.035093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21ebd0-ca2a-49d5-81d3-6cc40be9ff6d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:28.035556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21ebd0-ca2a-49d5-81d3-6cc40be9ff6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:28.035649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21ebd0-ca2a-49d5-81d3-6cc40be9ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:28.055841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8d21ebd0-ca2a-49d5-81d3-6cc40be9ff6d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:28.057026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8d21ebd0-ca2a-49d5-81d3-6cc40be9ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:28.065735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:25:28.386672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805263e-35aa-4bea-9cf1-d5d2476c9089 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:28.388714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4805263e-35aa-4bea-9cf1-d5d2476c9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:28.469322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805263e-35aa-4bea-9cf1-d5d2476c9089 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:28.473249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396ed0-7716-4eec-bcd0-e26f2c0f77e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:28.473895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396ed0-7716-4eec-bcd0-e26f2c0f77e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:28.474174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396ed0-7716-4eec-bcd0-e26f2c0f77e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:28.474476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396ed0-7716-4eec-bcd0-e26f2c0f77e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:28.485033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396ed0-7716-4eec-bcd0-e26f2c0f77e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:28.486492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396ed0-7716-4eec-bcd0-e26f2c0f77e7 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:28.496808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 769/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:30.545090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dc9a0-2503-4d9c-aad0-45f74f49eeb0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:30.545936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dc9a0-2503-4d9c-aad0-45f74f49eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:30.545936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dc9a0-2503-4d9c-aad0-45f74f49eeb0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:30.548035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 17:25:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:25:30.554432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74361-6b77-4760-b17a-a45994307fec None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:30.555152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74361-6b77-4760-b17a-a45994307fec None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:30.555152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74361-6b77-4760-b17a-a45994307fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:30.579855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f8c74361-6b77-4760-b17a-a45994307fec None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:25:30.581090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f8c74361-6b77-4760-b17a-a45994307fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:30.591129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 17:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:25:30.922171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dc9a0-2503-4d9c-aad0-45f74f49eeb0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:25:30.925680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-183dc9a0-2503-4d9c-aad0-45f74f49eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:25:30.942682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dc9a0-2503-4d9c-aad0-45f74f49eeb0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:25:30.947726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01ff19-1339-485c-b32e-0d28ee3f66fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:25:30.948375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01ff19-1339-485c-b32e-0d28ee3f66fb service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:25:30.948660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01ff19-1339-485c-b32e-0d28ee3f66fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:25:30.948937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01ff19-1339-485c-b32e-0d28ee3f66fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:25:30.959300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01ff19-1339-485c-b32e-0d28ee3f66fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:25:30.960904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01ff19-1339-485c-b32e-0d28ee3f66fb service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:25:30.971142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 769/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:25:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:25:40.574861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:25:40.966897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=33 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:04.677435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa74e-517a-4d4a-afd4-c4f4114d8e27 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.678095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa74e-517a-4d4a-afd4-c4f4114d8e27 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.678095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa74e-517a-4d4a-afd4-c4f4114d8e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.701224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-647fa74e-517a-4d4a-afd4-c4f4114d8e27 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:04.702667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-647fa74e-517a-4d4a-afd4-c4f4114d8e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:04.714692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae18d-0046-426a-bf86-e7dc0880ead8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.715910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae18d-0046-426a-bf86-e7dc0880ead8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.715910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ae18d-0046-426a-bf86-e7dc0880ead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.718762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 771/1540] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:04.734138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f667d-93b2-411d-8af7-415f36cb2c69 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.734138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f667d-93b2-411d-8af7-415f36cb2c69 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.734138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f667d-93b2-411d-8af7-415f36cb2c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.751545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3d9ae18d-0046-426a-bf86-e7dc0880ead8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:04.753383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3d9ae18d-0046-426a-bf86-e7dc0880ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:04.760151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2d4f667d-93b2-411d-8af7-415f36cb2c69 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:04.761639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d4f667d-93b2-411d-8af7-415f36cb2c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:04.769778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 770/1541] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:04.778738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 772/1542] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:27:04.779245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d22d-a1ed-4049-9080-2a009a28f14a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.779759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d22d-a1ed-4049-9080-2a009a28f14a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.780251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1d22d-a1ed-4049-9080-2a009a28f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.789293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f667d-93b2-411d-8af7-415f36cb2c69 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:04.804345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f667d-93b2-411d-8af7-415f36cb2c69 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:04.814310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-59a1d22d-a1ed-4049-9080-2a009a28f14a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:04.814310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-59a1d22d-a1ed-4049-9080-2a009a28f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:04.814644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:04.815344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.815344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.815796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.816585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:04.816885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:04.817907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:27:04.817907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 12 17:27:04.817907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: Jul 12 17:27:04.819141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:04.845025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 773/1543] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:04.848289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 771/1544] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:04.856660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:04.857414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d22d-a1ed-4049-9080-2a009a28f14a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:04.876751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1d22d-a1ed-4049-9080-2a009a28f14a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:04.877068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df10ac-a0b0-4c16-a063-6d8270f3f397 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:04.890722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fde732-b0d2-4f50-89c0-dc7c817f356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:04.891423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fde732-b0d2-4f50-89c0-dc7c817f356b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.891704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fde732-b0d2-4f50-89c0-dc7c817f356b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.892068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fde732-b0d2-4f50-89c0-dc7c817f356b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.893119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fde732-b0d2-4f50-89c0-dc7c817f356b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:04.893451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fde732-b0d2-4f50-89c0-dc7c817f356b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:04.894988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1098d2c-4c71-465b-ac93-eee85d9a87f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:04.895238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fde732-b0d2-4f50-89c0-dc7c817f356b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:04.895683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098d2c-4c71-465b-ac93-eee85d9a87f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.896609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098d2c-4c71-465b-ac93-eee85d9a87f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.897185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1098d2c-4c71-465b-ac93-eee85d9a87f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.898217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1098d2c-4c71-465b-ac93-eee85d9a87f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:04.899344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-f1098d2c-4c71-465b-ac93-eee85d9a87f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:27:04.899344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:27:04.899344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:27:04.900535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1098d2c-4c71-465b-ac93-eee85d9a87f5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:04.917125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 774/1545] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:04.918553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccfdd-f7cd-48e3-aa8d-3f5c044533be None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:04.918838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccfdd-f7cd-48e3-aa8d-3f5c044533be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:04.919109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ccfdd-f7cd-48e3-aa8d-3f5c044533be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:04.956340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f85ccfdd-f7cd-48e3-aa8d-3f5c044533be None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:04.957569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f85ccfdd-f7cd-48e3-aa8d-3f5c044533be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:04.972229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 775/1546] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:04.972864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ccfdd-f7cd-48e3-aa8d-3f5c044533be None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:04.991576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ccfdd-f7cd-48e3-aa8d-3f5c044533be None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.000175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.000536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 772/1547] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:04 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:27:05.000854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.001146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.001423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.001601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb256-996a-4000-903b-7b91f940cb6e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.001919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb256-996a-4000-903b-7b91f940cb6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.002249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.002470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbb256-996a-4000-903b-7b91f940cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.004230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.040390 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f8fbb256-996a-4000-903b-7b91f940cb6e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.041712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f8fbb256-996a-4000-903b-7b91f940cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.062773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 776/1548] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:04 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.063624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.144324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 773/1549] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.145556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9824-c971-4e07-99ee-65c12d5a2d21 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.145845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9824-c971-4e07-99ee-65c12d5a2d21 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.146122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9824-c971-4e07-99ee-65c12d5a2d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.152556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c4f6b-a99d-4cd7-b6ae-268d57be0834 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.157269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68fd55-2216-414a-8ca5-f19f26416ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.157947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68fd55-2216-414a-8ca5-f19f26416ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.159495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68fd55-2216-414a-8ca5-f19f26416ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.159495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68fd55-2216-414a-8ca5-f19f26416ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.159495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68fd55-2216-414a-8ca5-f19f26416ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.160570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-bd68fd55-2216-414a-8ca5-f19f26416ad4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:27:05.160570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 12 17:27:05.160570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: Jul 12 17:27:05.161999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68fd55-2216-414a-8ca5-f19f26416ad4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.169704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-61fe9824-c971-4e07-99ee-65c12d5a2d21 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.170929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-61fe9824-c971-4e07-99ee-65c12d5a2d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.179530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 774/1550] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.180292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe9824-c971-4e07-99ee-65c12d5a2d21 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.183436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 777/1551] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.186594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d2267-c76f-43f1-b9ac-7738a91f8fc6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.186594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d2267-c76f-43f1-b9ac-7738a91f8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.186594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d2267-c76f-43f1-b9ac-7738a91f8fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.193067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe9824-c971-4e07-99ee-65c12d5a2d21 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.197679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1694d-0b9f-4a78-b9b2-b946edc9c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.198382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1694d-0b9f-4a78-b9b2-b946edc9c362 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.198664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1694d-0b9f-4a78-b9b2-b946edc9c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.198935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1694d-0b9f-4a78-b9b2-b946edc9c362 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.199629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1694d-0b9f-4a78-b9b2-b946edc9c362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.201583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1694d-0b9f-4a78-b9b2-b946edc9c362 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.203869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-529d2267-c76f-43f1-b9ac-7738a91f8fc6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.205287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-529d2267-c76f-43f1-b9ac-7738a91f8fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.213656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 778/1552] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.215153 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763ba4-9247-4cda-aa72-ac946252c7fb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.215442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763ba4-9247-4cda-aa72-ac946252c7fb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.215721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56763ba4-9247-4cda-aa72-ac946252c7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.229739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 775/1553] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/users => generated 282 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.231134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d75a-47ed-4288-8013-84463e9cc8ec None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.231419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d75a-47ed-4288-8013-84463e9cc8ec None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.231693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980d75a-47ed-4288-8013-84463e9cc8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.235233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-56763ba4-9247-4cda-aa72-ac946252c7fb None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.236491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-56763ba4-9247-4cda-aa72-ac946252c7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.245002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 779/1554] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.245875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56763ba4-9247-4cda-aa72-ac946252c7fb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.250986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7980d75a-47ed-4288-8013-84463e9cc8ec None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.252346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7980d75a-47ed-4288-8013-84463e9cc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.260511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 776/1555] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.261890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d88d-8505-49b7-b0c1-2077e5d02236 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.262182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d88d-8505-49b7-b0c1-2077e5d02236 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.262452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56763ba4-9247-4cda-aa72-ac946252c7fb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.262575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582d88d-8505-49b7-b0c1-2077e5d02236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.272633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.273343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.273811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.274088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.275737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:05.276044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.278209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.286730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9582d88d-8505-49b7-b0c1-2077e5d02236 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.287981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9582d88d-8505-49b7-b0c1-2077e5d02236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.291929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 780/1556] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:05.292596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.296974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 777/1557] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.298379 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c136f6-aa41-46a0-9ae0-30eec7e40dc1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.298672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c136f6-aa41-46a0-9ae0-30eec7e40dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.298999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c136f6-aa41-46a0-9ae0-30eec7e40dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.304878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72f1bc-8801-4ea9-8cc8-1ee461eaddb4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.309702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0316083-c54d-422b-80ee-3af33c97565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.310412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316083-c54d-422b-80ee-3af33c97565b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.310729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316083-c54d-422b-80ee-3af33c97565b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.311007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0316083-c54d-422b-80ee-3af33c97565b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.311736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0316083-c54d-422b-80ee-3af33c97565b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.313361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0316083-c54d-422b-80ee-3af33c97565b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.317721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-12c136f6-aa41-46a0-9ae0-30eec7e40dc1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.319036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-12c136f6-aa41-46a0-9ae0-30eec7e40dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.324290 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 781/1558] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:05.325580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc048cfd-47c4-4cb5-beb7-3da58032a15c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.325930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc048cfd-47c4-4cb5-beb7-3da58032a15c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.326271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc048cfd-47c4-4cb5-beb7-3da58032a15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.327644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 778/1559] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.328040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c136f6-aa41-46a0-9ae0-30eec7e40dc1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.337573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c136f6-aa41-46a0-9ae0-30eec7e40dc1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.342173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4547c1-55b3-4522-95d7-a2a7296121cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.342867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4547c1-55b3-4522-95d7-a2a7296121cc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.343150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4547c1-55b3-4522-95d7-a2a7296121cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.343422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4547c1-55b3-4522-95d7-a2a7296121cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.343801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fc048cfd-47c4-4cb5-beb7-3da58032a15c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.344146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4547c1-55b3-4522-95d7-a2a7296121cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.344989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc048cfd-47c4-4cb5-beb7-3da58032a15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.345810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4547c1-55b3-4522-95d7-a2a7296121cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.353213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 782/1560] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.357307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1640d1d-8f6f-48ea-9632-9510a08e1e12 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.357307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1640d1d-8f6f-48ea-9632-9510a08e1e12 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.357307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1640d1d-8f6f-48ea-9632-9510a08e1e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.357958 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 779/1561] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:05.358530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1af66-5e77-4eef-b10f-57c35dd2ec79 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.358727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1af66-5e77-4eef-b10f-57c35dd2ec79 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.359074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1af66-5e77-4eef-b10f-57c35dd2ec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.374083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e1640d1d-8f6f-48ea-9632-9510a08e1e12 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.375370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e1640d1d-8f6f-48ea-9632-9510a08e1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.378365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8fa1af66-5e77-4eef-b10f-57c35dd2ec79 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.379539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8fa1af66-5e77-4eef-b10f-57c35dd2ec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.383764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 783/1562] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.384479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1640d1d-8f6f-48ea-9632-9510a08e1e12 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.389877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 780/1563] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.391125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ad9b-1e9f-41e1-8413-7385b02a6cbf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.391412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ad9b-1e9f-41e1-8413-7385b02a6cbf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.391686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02ad9b-1e9f-41e1-8413-7385b02a6cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.399974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1640d1d-8f6f-48ea-9632-9510a08e1e12 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.405204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.405920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.406241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.406513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.407214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.409231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.412530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4b02ad9b-1e9f-41e1-8413-7385b02a6cbf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:05.414102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4b02ad9b-1e9f-41e1-8413-7385b02a6cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:05.423343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 781/1564] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:05.424176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ad9b-1e9f-41e1-8413-7385b02a6cbf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.434719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02ad9b-1e9f-41e1-8413-7385b02a6cbf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.439260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.439440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 784/1565] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.440007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.440299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.440573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.440903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.441341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.443107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.450706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:05.463079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 782/1566] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:05.463079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.472399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154cf39-f9ac-4920-a763-f9ddfbe0b9eb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.506792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd836aa-df6c-4005-bf4a-384d66bfc4b8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.507589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:05.511788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.512461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.512900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.513154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.513892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:05.514203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.515952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.528116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 785/1567] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:05.528941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.538719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb232d4-124d-44c0-ae3f-a4d6cbb8af70 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.541185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.541872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.542153 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.542453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.543191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:05.543495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.543948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.544578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.544870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.545078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.545183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.545850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.547836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.557173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 783/1568] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:05.558036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.561423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 786/1569] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:05.561423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.574057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42177de4-fa73-4d62-873a-b4a2a61a31f3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.574245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698fa45-b3c7-4c4b-86e1-5a471e9e9587 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.578915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.579605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.579762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.579869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.580401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.580558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.580739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.580995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.581127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:05.581372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.581823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:05.582135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.583009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.583848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.603772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 787/1570] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:05.603772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.604075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 784/1571] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:05.604075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.613754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6950750-f24e-4daa-b650-3db208caeec5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.614033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b6c53-28dd-4ee3-b29d-cc71bdb608c5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.618510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.618666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.619182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.619332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.619472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.619620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.619780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.619882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.620474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.620612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:05.620939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.622445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.622549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.642601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 788/1572] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:05.642601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.646430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 785/1573] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.646879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5b500-f557-4305-8d63-dcf103d204cd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.647426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.652299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.653139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.653459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.653734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] PATH_INFO: `/v3/projects/5fbbd30fa8014e12a10a310efbe29ea6/users/6421f45a7ac548918e8c81013720b3c0/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.658211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb828291-36eb-48ae-8206-33896dd89ebf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.663197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.663994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.664276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.664545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.665233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.667207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.669222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbbd30fa8014e12a10a310efbe29ea6, user_id=6421f45a7ac548918e8c81013720b3c0, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.671925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.688503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 789/1574] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:05 2022] PUT /identity/v3/projects/5fbbd30fa8014e12a10a310efbe29ea6/users/6421f45a7ac548918e8c81013720b3c0/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:05.689440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.701274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 786/1575] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.701274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.766382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4322c-c841-4eb6-b49b-1dc750977bc2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.766802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb460e3-f968-436e-b336-614fe5efd6ea admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.771377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.772277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.772414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.772549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.772818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] PATH_INFO: `/v3/projects/417f198f02394900974c6116e2f45fa5/users/782ec4e0773e4c598a7b3878666eb374/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.772974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.773227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.773503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.774274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.776434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.788372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417f198f02394900974c6116e2f45fa5, user_id=782ec4e0773e4c598a7b3878666eb374, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.791167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.804542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 787/1576] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.805593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.805742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 790/1577] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:05 2022] PUT /identity/v3/projects/417f198f02394900974c6116e2f45fa5/users/782ec4e0773e4c598a7b3878666eb374/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:05.806414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.838973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:05.876091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a27b67-32ae-4d02-b644-685551660270 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.879295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2b30e-9966-417a-a0a3-ce9bc9bc9329 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.881021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.881688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.881966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.882241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.882963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.883948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.884615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.884874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.884992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.885164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.885852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.887829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.896991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:05.911570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 791/1578] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.912326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.916667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 788/1579] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:05.917496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:05.979608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd00e5-91e2-44e7-b483-f41976c24e9e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.980053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc52cd-59f7-455d-b38b-9059fe36baf4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:05.985052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18019443-ab06-466e-b1c1-10a3d1548330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.985185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:05.985757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019443-ab06-466e-b1c1-10a3d1548330 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.985866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:05.986026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019443-ab06-466e-b1c1-10a3d1548330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.986127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:05.986369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019443-ab06-466e-b1c1-10a3d1548330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.986486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:05.987227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18019443-ab06-466e-b1c1-10a3d1548330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.987480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:05.988884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18019443-ab06-466e-b1c1-10a3d1548330 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.989450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:05.998784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 789/1580] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.000032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38554-0ea3-443f-89a9-ca1c2fa6fc6a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.000314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38554-0ea3-443f-89a9-ca1c2fa6fc6a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.000589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a38554-0ea3-443f-89a9-ca1c2fa6fc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.020171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 792/1581] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.020983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.030530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1a38554-0ea3-443f-89a9-ca1c2fa6fc6a None None] MFA Rules not processed for user `6421f45a7ac548918e8c81013720b3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:06.031838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1a38554-0ea3-443f-89a9-ca1c2fa6fc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:06.085452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3db08-1fed-47c6-b854-13988e2784f2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.089912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52f143-6db6-4c07-abe2-2d95e06b8380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.090621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52f143-6db6-4c07-abe2-2d95e06b8380 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.090903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52f143-6db6-4c07-abe2-2d95e06b8380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.091177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52f143-6db6-4c07-abe2-2d95e06b8380 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.091890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52f143-6db6-4c07-abe2-2d95e06b8380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.093853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52f143-6db6-4c07-abe2-2d95e06b8380 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.099171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 790/1582] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:06.103427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38554-0ea3-443f-89a9-ca1c2fa6fc6a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.114612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a38554-0ea3-443f-89a9-ca1c2fa6fc6a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.115092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 793/1583] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.116383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45d7a-ce30-4b6f-9613-842257535a12 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.116704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45d7a-ce30-4b6f-9613-842257535a12 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.116978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b45d7a-ce30-4b6f-9613-842257535a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.122692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.123376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.123646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.123930 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.124811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.126840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.143684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-75b45d7a-ce30-4b6f-9613-842257535a12 None None] MFA Rules not processed for user `782ec4e0773e4c598a7b3878666eb374`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:06.144964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-75b45d7a-ce30-4b6f-9613-842257535a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:06.148278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 791/1584] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.149084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.158904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1450f-2551-4469-a731-8d615dd7eb73 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.160268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:06.165100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.165743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.166024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.166325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.167022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.169077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.189646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 792/1585] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.191102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.201629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc780b48-c1a4-438c-a58d-f827a09d5f2d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.207031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.207698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.208141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.208395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.209608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.211624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.217686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 794/1586] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:06.219352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b45d7a-ce30-4b6f-9613-842257535a12 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.232013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b45d7a-ce30-4b6f-9613-842257535a12 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.233922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 793/1587] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.234754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.237619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.238318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.238616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.238893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.239689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.241246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.244384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8007f-3283-4e88-b946-88f7063338c7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.249307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.249959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.250241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.250550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.251251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.251666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 795/1588] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.252310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.253504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.263219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d608cd7-f39e-45c5-b2c3-7cb13f3455f5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.268597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.269321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.269754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.270037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.270805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.272716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.275162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 794/1589] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.278994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.285143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:06.289160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170cc61-42fa-4a2a-abb1-5109d9ce2a17 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.299078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 796/1590] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.300277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.303074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.303777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.304059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.304379 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.305448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.308907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.321331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 795/1591] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.322169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.332719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614d08e-9b17-4d16-a341-8a35ce894ddc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.366037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5075-7cb6-4c6c-aa48-9d7fcff85298 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.371031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.371713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.371994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.372266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.372996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.374649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.384788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 797/1592] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.385607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.395903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743abd0-c169-4946-9ba4-c726a4c5159b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.397347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.398109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.398501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.398990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.399738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.400912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.401571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.401807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.401918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.402116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.402836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.404734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.413491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 796/1593] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.414315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.426136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fd1c8-a85a-4667-a9d8-8c50f494905e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.431361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.432034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.432315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.432589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.433314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.436547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 798/1594] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.436547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.436815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.449824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 797/1595] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.449824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.460110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43542b0d-3ac4-4bf1-a9e4-7fbb06838982 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.496953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:06.502393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b575b-c4b0-4a66-9779-cc6ba89b174a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.508022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.508955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.509236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.509506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] PATH_INFO: `/v3/projects/44be58fc071b4bc0a71209b14af25335/users/190092274f6843959bf16a569a388ccf/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.517248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.518030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.518332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.518609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.519335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.520944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.525113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44be58fc071b4bc0a71209b14af25335, user_id=190092274f6843959bf16a569a388ccf, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.527809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.531124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 798/1596] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.532030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.541983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3657-9de5-4163-9461-2f0944f5f67f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.543839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 799/1597] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:06 2022] PUT /identity/v3/projects/44be58fc071b4bc0a71209b14af25335/users/190092274f6843959bf16a569a388ccf/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:06.544596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.607010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.608067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.608829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.609248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.609965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.610097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0ecde-5987-448d-84cb-67641dd53d44 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.611988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.614807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.615482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.615765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.616039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.616769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.618382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.629544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 800/1598] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.632546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 799/1599] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.633581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.635235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.639512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:06.644992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8860dd2-f3c7-46e3-9573-61e65e592f2c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.646344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa6f5-6527-47fe-91ed-c5c13185ccb3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.650392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.651056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.651177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.651338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.651609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.651817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.652102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.652356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.652468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.653081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.653994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.654715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.664472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 800/1600] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.665232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.668289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 801/1601] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.669159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.675106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fbb4-2cea-46e3-8611-42e2b54b179a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.679147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfee1ba-e3e0-4dba-8b5f-3aae505c3ad6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.679790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae4ee1-e350-4ab9-8505-615fc07f24f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.680528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4ee1-e350-4ab9-8505-615fc07f24f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.680810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4ee1-e350-4ab9-8505-615fc07f24f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.681085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae4ee1-e350-4ab9-8505-615fc07f24f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.681799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae4ee1-e350-4ab9-8505-615fc07f24f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.683741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae4ee1-e350-4ab9-8505-615fc07f24f9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.683890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.684487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.684768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.685044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.685779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.687387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.697778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 802/1602] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.698637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.706802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 801/1603] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:06.708114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313ee0-a420-4a3d-acab-9587b161dbcf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.708402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313ee0-a420-4a3d-acab-9587b161dbcf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.708676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313ee0-a420-4a3d-acab-9587b161dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.708867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4e03c-7e42-4f40-b293-038beba578a8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.713637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.714499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.714855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.715200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.715930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.717519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.726901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-18313ee0-a420-4a3d-acab-9587b161dbcf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:06.728115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-18313ee0-a420-4a3d-acab-9587b161dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:06.730446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 803/1604] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.731528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.737333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 802/1605] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:06.738237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313ee0-a420-4a3d-acab-9587b161dbcf None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.745918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda327a9-e31e-4441-bf27-3d49be49e564 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.747990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313ee0-a420-4a3d-acab-9587b161dbcf None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.751404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.752402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.752658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.752934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] PATH_INFO: `/v3/projects/c8acacb90c2649c09bf8b096e4a9f096/users/7e5a33e74f604488b83efeec71ca7981/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.753230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.753909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.754193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.754522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.755279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.756892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.767508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 803/1606] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:06.768101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8acacb90c2649c09bf8b096e4a9f096, user_id=7e5a33e74f604488b83efeec71ca7981, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.768554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.770796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.779351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03f499-8c5e-49f2-8057-e468412b66a1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.790550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 804/1607] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:06 2022] PUT /identity/v3/projects/c8acacb90c2649c09bf8b096e4a9f096/users/7e5a33e74f604488b83efeec71ca7981/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:06.790550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.844945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.845940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.846675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.847096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] PATH_INFO: `/v3/projects/5e4579e62fe946c0848d19f6e00047a4/users/58298868d67d4aa584a9fed53e4358a2/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.863512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e4579e62fe946c0848d19f6e00047a4, user_id=58298868d67d4aa584a9fed53e4358a2, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.864570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:27:06.864570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:27:06.864570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:27:06.866704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.868993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e1a9c-29ee-4d3d-80e6-20dcb4b2f027 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.874474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.875572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:06.876115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:06.876563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] PATH_INFO: `/v3/projects/bfec9b4372e9483584e8ae2b99544223/users/8a39c802d1d24a41847f540ea55846d9/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:06.886179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 804/1608] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:06 2022] PUT /identity/v3/projects/5e4579e62fe946c0848d19f6e00047a4/users/58298868d67d4aa584a9fed53e4358a2/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:06.887052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.899718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfec9b4372e9483584e8ae2b99544223, user_id=8a39c802d1d24a41847f540ea55846d9, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:06.902561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:06.913951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:06.920619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 805/1609] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:06 2022] PUT /identity/v3/projects/bfec9b4372e9483584e8ae2b99544223/users/8a39c802d1d24a41847f540ea55846d9/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:06.921677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:06.958664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d7670-d37f-47d9-80ac-2dd7e257ab0a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.993238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e776618-a64e-4618-a96d-078128e6a677 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:06.999029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:06.999932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.000211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.000493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.001247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.002965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.006335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:07.014702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 806/1610] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:07.015520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.019025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.019970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.020371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.020652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] PATH_INFO: `/v3/projects/53b09ab3c6fc459c99223298d4284f28/users/0ffbfc994b03410faf1a124ac7d4cc72/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.026042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f14cc-4702-4a87-9b1d-77c39f3e5368 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.031166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.032047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.032590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.032590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] PATH_INFO: `/v3/projects/e9f9a066392944adb64b1c9d5046b436/users/17b17a4ca5524e38a8b24dd3e72e0921/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.035227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b09ab3c6fc459c99223298d4284f28, user_id=0ffbfc994b03410faf1a124ac7d4cc72, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.037917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.049189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f9a066392944adb64b1c9d5046b436, user_id=17b17a4ca5524e38a8b24dd3e72e0921, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.051889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.052005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 805/1611] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:06 2022] PUT /identity/v3/projects/53b09ab3c6fc459c99223298d4284f28/users/0ffbfc994b03410faf1a124ac7d4cc72/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:07.052728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.054332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.066033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 807/1612] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:07 2022] PUT /identity/v3/projects/e9f9a066392944adb64b1c9d5046b436/users/17b17a4ca5524e38a8b24dd3e72e0921/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:07.067032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.122740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935229c-eb06-4d94-b788-eecfca295e1c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.140062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2ab7d-0f99-4b28-be2e-959fd00ffd2f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.145860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c756a2-0d81-4e92-a0cd-1a2070080ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.146809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c756a2-0d81-4e92-a0cd-1a2070080ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.147096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c756a2-0d81-4e92-a0cd-1a2070080ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.147377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c756a2-0d81-4e92-a0cd-1a2070080ffc admin admin] PATH_INFO: `/v3/projects/f96aaab15e0a4aab8bda3622c8879b13/users/8fb1271fa674443288c681e1b43a66a4/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.162897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c756a2-0d81-4e92-a0cd-1a2070080ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96aaab15e0a4aab8bda3622c8879b13, user_id=8fb1271fa674443288c681e1b43a66a4, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.165720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c756a2-0d81-4e92-a0cd-1a2070080ffc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.172968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72619894-a599-4259-9204-994848a86e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.173788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72619894-a599-4259-9204-994848a86e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.174140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72619894-a599-4259-9204-994848a86e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.174328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72619894-a599-4259-9204-994848a86e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.184197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 808/1613] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:07 2022] PUT /identity/v3/projects/f96aaab15e0a4aab8bda3622c8879b13/users/8fb1271fa674443288c681e1b43a66a4/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:07.184600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72619894-a599-4259-9204-994848a86e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.185516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a391d59-485d-4ad5-8a78-65119f34e5d6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.185807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a391d59-485d-4ad5-8a78-65119f34e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.186062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72619894-a599-4259-9204-994848a86e9a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.186165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a391d59-485d-4ad5-8a78-65119f34e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.197970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 806/1614] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:07.199311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5566-b21d-4d17-af03-10ba3841efd8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.199602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5566-b21d-4d17-af03-10ba3841efd8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.199881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5566-b21d-4d17-af03-10ba3841efd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.204312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7a391d59-485d-4ad5-8a78-65119f34e5d6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:07.205871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a391d59-485d-4ad5-8a78-65119f34e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.218051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e5ff5566-b21d-4d17-af03-10ba3841efd8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:07.219208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e5ff5566-b21d-4d17-af03-10ba3841efd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.267025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:07.281737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 809/1615] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:07.283109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c26dd-3136-491b-be2a-9b039f6999e9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.283672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c26dd-3136-491b-be2a-9b039f6999e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.283672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c26dd-3136-491b-be2a-9b039f6999e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.303720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 807/1616] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:07.304862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff5566-b21d-4d17-af03-10ba3841efd8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.314966 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff5566-b21d-4d17-af03-10ba3841efd8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.320714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b43fa-9b70-4b48-bf70-b9c1272980ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.321629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b43fa-9b70-4b48-bf70-b9c1272980ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.321916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b43fa-9b70-4b48-bf70-b9c1272980ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.322187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b43fa-9b70-4b48-bf70-b9c1272980ad admin admin] PATH_INFO: `/v3/projects/05725378dd714f078c080a060822c07f/users/d7c819ab012941ae98bb3f8d8e0cd4f4/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.324961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-218c26dd-3136-491b-be2a-9b039f6999e9 None None] MFA Rules not processed for user `8a39c802d1d24a41847f540ea55846d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:07.326235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-218c26dd-3136-491b-be2a-9b039f6999e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.339724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b43fa-9b70-4b48-bf70-b9c1272980ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=05725378dd714f078c080a060822c07f, user_id=d7c819ab012941ae98bb3f8d8e0cd4f4, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.342469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b43fa-9b70-4b48-bf70-b9c1272980ad admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.359993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 808/1617] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:07 2022] PUT /identity/v3/projects/05725378dd714f078c080a060822c07f/users/d7c819ab012941ae98bb3f8d8e0cd4f4/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:07.361913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c024-528c-4c2d-9c8c-08d7e595ae2b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.362561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c024-528c-4c2d-9c8c-08d7e595ae2b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.362937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c024-528c-4c2d-9c8c-08d7e595ae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.377270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:07.384276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d674c024-528c-4c2d-9c8c-08d7e595ae2b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:07.385464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d674c024-528c-4c2d-9c8c-08d7e595ae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.402180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 810/1618] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:07.403718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9361be-de9e-4203-adc7-1384054140e9 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.404006 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9361be-de9e-4203-adc7-1384054140e9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.404287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9361be-de9e-4203-adc7-1384054140e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.446812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7e9361be-de9e-4203-adc7-1384054140e9 None None] MFA Rules not processed for user `17b17a4ca5524e38a8b24dd3e72e0921`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:07.448084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7e9361be-de9e-4203-adc7-1384054140e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.487072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 809/1619] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:07.487952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c024-528c-4c2d-9c8c-08d7e595ae2b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.497909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c024-528c-4c2d-9c8c-08d7e595ae2b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.504196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.505013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.505506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.505685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.506528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.508225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.519611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 810/1620] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:07.520527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.532018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 811/1621] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:07.532789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9361be-de9e-4203-adc7-1384054140e9 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.584720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76794db7-a2f6-4d1c-88c4-ed672cbdd763 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.592758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.593815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.594101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.594414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.601130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9361be-de9e-4203-adc7-1384054140e9 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.605280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab33c0b-c38c-4dc3-930c-0b5133a28404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.606184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab33c0b-c38c-4dc3-930c-0b5133a28404 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.606692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab33c0b-c38c-4dc3-930c-0b5133a28404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.607117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab33c0b-c38c-4dc3-930c-0b5133a28404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.611810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.613668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.618682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab33c0b-c38c-4dc3-930c-0b5133a28404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.620537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab33c0b-c38c-4dc3-930c-0b5133a28404 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.633383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 811/1622] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:07.633821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 812/1623] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:07.635447 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.635740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bf37-211b-4069-9d32-8464628dc380 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.636292 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bf37-211b-4069-9d32-8464628dc380 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.636729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bf37-211b-4069-9d32-8464628dc380 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.638329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 813/1624] 10.222.0.50 () {54 vars in 961 bytes} [Tue Jul 12 17:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:07.639170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9bf37-211b-4069-9d32-8464628dc380 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.652074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9bf37-211b-4069-9d32-8464628dc380 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.654672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760a949-12d2-4cf8-b2c4-e36cd1c55725 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.657988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.660425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.660816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.660971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.661136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.661248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.661417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.661704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.662485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.664312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.671776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.673256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.676942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 812/1625] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:07.677784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.687864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 814/1626] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:07.688217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e016f6e-46e3-4100-8259-6ad2f2aea855 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.688906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.693345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ef228-bb26-495d-a9ae-c9f38e345c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.694196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef228-bb26-495d-a9ae-c9f38e345c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.694528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef228-bb26-495d-a9ae-c9f38e345c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.694800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ef228-bb26-495d-a9ae-c9f38e345c66 admin admin] PATH_INFO: `/v3/projects/f96aaab15e0a4aab8bda3622c8879b13/users/8fb1271fa674443288c681e1b43a66a4/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.696021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:07.697822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ef228-bb26-495d-a9ae-c9f38e345c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96aaab15e0a4aab8bda3622c8879b13, user_id=8fb1271fa674443288c681e1b43a66a4, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.700289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e23a54-b714-4d6d-bbcd-484394b68afa service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.700961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741ef228-bb26-495d-a9ae-c9f38e345c66 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.714562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 813/1627] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:07 2022] PUT /identity/v3/projects/f96aaab15e0a4aab8bda3622c8879b13/users/8fb1271fa674443288c681e1b43a66a4/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:07.714968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.715947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.716179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424962d0-e9ee-4d61-9504-e08e392f1578 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.716535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.716668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424962d0-e9ee-4d61-9504-e08e392f1578 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.716896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424962d0-e9ee-4d61-9504-e08e392f1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.717333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.718179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.721274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.764588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 815/1628] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:07.765983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.769897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-424962d0-e9ee-4d61-9504-e08e392f1578 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:07.771346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-424962d0-e9ee-4d61-9504-e08e392f1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.828733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:07.847888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 814/1629] 10.222.0.50 () {58 vars in 1058 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:07.848124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46060b-bcca-47da-b470-e1d6ada5dad5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.853493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.854530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.854714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.855227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] PATH_INFO: `/v3/projects/05725378dd714f078c080a060822c07f/users/d7c819ab012941ae98bb3f8d8e0cd4f4/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.857156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05725378dd714f078c080a060822c07f, user_id=d7c819ab012941ae98bb3f8d8e0cd4f4, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.859028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864971-e42a-4677-a2f3-7e670aff3049 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.859585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864971-e42a-4677-a2f3-7e670aff3049 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.859961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15864971-e42a-4677-a2f3-7e670aff3049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.860702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.873530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 816/1630] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:07 2022] PUT /identity/v3/projects/05725378dd714f078c080a060822c07f/users/d7c819ab012941ae98bb3f8d8e0cd4f4/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:07.874182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:07.895008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-15864971-e42a-4677-a2f3-7e670aff3049 None None] MFA Rules not processed for user `8fb1271fa674443288c681e1b43a66a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:07.896225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-15864971-e42a-4677-a2f3-7e670aff3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:07.961706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c98382-84aa-4bd2-ad2a-3daf0804ef28 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:07.966673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b7eae-e9e2-43f4-8876-3ee7b2c431ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:07.967359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7eae-e9e2-43f4-8876-3ee7b2c431ed admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:07.967641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7eae-e9e2-43f4-8876-3ee7b2c431ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:07.967921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7eae-e9e2-43f4-8876-3ee7b2c431ed admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:07.968614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7eae-e9e2-43f4-8876-3ee7b2c431ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:07.971032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7eae-e9e2-43f4-8876-3ee7b2c431ed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:07.979785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 815/1631] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:07.979785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15864971-e42a-4677-a2f3-7e670aff3049 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.005099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 817/1632] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:07 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:08.006596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1984af-da97-4902-9698-83a60c1857e4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.006886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1984af-da97-4902-9698-83a60c1857e4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.007166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1984af-da97-4902-9698-83a60c1857e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.042835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bc1984af-da97-4902-9698-83a60c1857e4 None None] MFA Rules not processed for user `d7c819ab012941ae98bb3f8d8e0cd4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:08.044502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bc1984af-da97-4902-9698-83a60c1857e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:08.071163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15864971-e42a-4677-a2f3-7e670aff3049 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.079649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.080711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.081096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.081462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.117973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:08.141423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 818/1633] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:08.147025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.147459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1984af-da97-4902-9698-83a60c1857e4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.148732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.160850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 816/1634] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:08.161754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.174245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365f3a2-c81e-434f-bb80-390977341992 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.180300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.180990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.181275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.181775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.182480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.184479 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.197879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 817/1635] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:08.199049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.207549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:08.251297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1984af-da97-4902-9698-83a60c1857e4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.256686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.258406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.258819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.259238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.266383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278643a-59cf-4086-9610-c4ed0481f2ee admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.271067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.272064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.272064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.272374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.275142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.277506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.285488 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.287345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.295908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 819/1636] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:08.299364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.301324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 818/1637] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:08.313432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66c673-87e3-448e-8a65-2d36b405effc service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.319192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.320647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.321474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.321821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] PATH_INFO: `/v3/projects/289104ca8b2a4fee8cd66e19d39aff83/users/47721b22d76f44c1acb3f9df0aea99ba/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.343857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=289104ca8b2a4fee8cd66e19d39aff83, user_id=47721b22d76f44c1acb3f9df0aea99ba, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.346986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.372014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 820/1638] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:08 2022] PUT /identity/v3/projects/289104ca8b2a4fee8cd66e19d39aff83/users/47721b22d76f44c1acb3f9df0aea99ba/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:08.376019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.406084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79b01-4567-4a18-9df6-bebd9947fe52 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.467635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.520303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.521013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.521295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.522074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.525853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.527566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.553600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 819/1639] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:27:08.554743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.578469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46ba55-9562-4ba9-8d1f-b44415d0b09c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.586953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4834b7-240a-4a29-8b1e-20696cdffdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.588409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4834b7-240a-4a29-8b1e-20696cdffdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.588409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4834b7-240a-4a29-8b1e-20696cdffdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.588409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4834b7-240a-4a29-8b1e-20696cdffdfd admin admin] PATH_INFO: `/v3/projects/289104ca8b2a4fee8cd66e19d39aff83/users/47721b22d76f44c1acb3f9df0aea99ba/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.596611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4834b7-240a-4a29-8b1e-20696cdffdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=289104ca8b2a4fee8cd66e19d39aff83, user_id=47721b22d76f44c1acb3f9df0aea99ba, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.604498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4834b7-240a-4a29-8b1e-20696cdffdfd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.615590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0213d-968e-4918-adf7-5e84b12bdf07 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:08.621439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d98a03-a7ff-457a-bf75-d8747cb1a02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:08.622106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d98a03-a7ff-457a-bf75-d8747cb1a02e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.622421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d98a03-a7ff-457a-bf75-d8747cb1a02e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.622693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d98a03-a7ff-457a-bf75-d8747cb1a02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.627748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 820/1640] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:08 2022] PUT /identity/v3/projects/289104ca8b2a4fee8cd66e19d39aff83/users/47721b22d76f44c1acb3f9df0aea99ba/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:08.629193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7fbd-981e-446d-8944-16ce9ba7b9a6 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.629601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7fbd-981e-446d-8944-16ce9ba7b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.630114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7fbd-981e-446d-8944-16ce9ba7b9a6 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.637460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 821/1641] 10.222.0.50 () {54 vars in 912 bytes} [Tue Jul 12 17:27:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:08.639748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d075-4094-4d84-9fd3-3a0676cf5249 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.641099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d075-4094-4d84-9fd3-3a0676cf5249 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.641603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694d075-4094-4d84-9fd3-3a0676cf5249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.690009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e694d075-4094-4d84-9fd3-3a0676cf5249 None None] MFA Rules not processed for user `47721b22d76f44c1acb3f9df0aea99ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:08.693237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e694d075-4094-4d84-9fd3-3a0676cf5249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:08.747494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d98a03-a7ff-457a-bf75-d8747cb1a02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:08.749133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d98a03-a7ff-457a-bf75-d8747cb1a02e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:08.763405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 821/1642] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:08 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:27:08.766696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d4ce-b8b3-47cb-a8a7-3480ef25103c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:08.767783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d4ce-b8b3-47cb-a8a7-3480ef25103c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:08.769070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d4ce-b8b3-47cb-a8a7-3480ef25103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:08.842509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5983d4ce-b8b3-47cb-a8a7-3480ef25103c None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:08.844064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5983d4ce-b8b3-47cb-a8a7-3480ef25103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:08.875200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 822/1643] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:08.898315 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:08.929893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d075-4094-4d84-9fd3-3a0676cf5249 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:08.967292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:09.014276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 822/1644] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:27:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:09.061327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694d075-4094-4d84-9fd3-3a0676cf5249 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:09.066916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:09.067637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:09.067933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:09.068209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:09.079371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:09.082086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:09.095374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 823/1645] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:09.130276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983d4ce-b8b3-47cb-a8a7-3480ef25103c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:09.200875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:09.213572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66763b-25f0-4ecc-9f87-73a508e6174d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:09.222610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:09.224022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:09.225261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:09.226461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:09.257205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:09.258769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:09.285765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 824/1646] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:09.304912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983d4ce-b8b3-47cb-a8a7-3480ef25103c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:09.319910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:09.320892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:09.321171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:09.321464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] PATH_INFO: `/v3/users/17b17a4ca5524e38a8b24dd3e72e0921` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:09.324873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b17a4ca5524e38a8b24dd3e72e0921)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:09.331280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:09.455115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b17a4ca5524e38a8b24dd3e72e0921'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.476472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b17a4ca5524e38a8b24dd3e72e0921'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.503964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b17a4ca5524e38a8b24dd3e72e0921'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.507432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:09.523180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b17a4ca5524e38a8b24dd3e72e0921'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.527557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e458-dc8c-4bcc-b0d4-3304cb1caa44 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:09.528095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fad78dbf-d315-422d-8021-c45f7cbc7413 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b17a4ca5524e38a8b24dd3e72e0921'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.538005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:09.538553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:09.538839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:09.539114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] PATH_INFO: `/v3/users/782ec4e0773e4c598a7b3878666eb374` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:09.541229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 823/1647] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:09 2022] DELETE /identity/v3/users/17b17a4ca5524e38a8b24dd3e72e0921 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:09.543078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=782ec4e0773e4c598a7b3878666eb374)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:09.545016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: WARNING py.warnings [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:27:09.545016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: warnings.warn(msg) Jul 12 17:27:09.545016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: Jul 12 17:27:09.546151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c1ee-75d1-4b17-9418-778851152a72 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:09.546314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:09.546635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c1ee-75d1-4b17-9418-778851152a72 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:09.547034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c1ee-75d1-4b17-9418-778851152a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:09.583894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6d02c1ee-75d1-4b17-9418-778851152a72 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:09.587721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d02c1ee-75d1-4b17-9418-778851152a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:09.659790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:09.686013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782ec4e0773e4c598a7b3878666eb374'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.686867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782ec4e0773e4c598a7b3878666eb374'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.687696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782ec4e0773e4c598a7b3878666eb374'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.711585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782ec4e0773e4c598a7b3878666eb374'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.725252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 824/1648] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:27:09.762941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782ec4e0773e4c598a7b3878666eb374'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:09.803418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 825/1649] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:09 2022] DELETE /identity/v3/users/782ec4e0773e4c598a7b3878666eb374 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:09.805474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:09.806017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:09.806236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:09.835867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:09.837443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:09.962590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 825/1650] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:09.998374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:09.999931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:10.082630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:10.084366 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:10.146984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a409cc-0444-4ca7-a983-5eb85c51f016 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:10.157374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064d949-98bb-428d-8537-79c6abff3bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:10.158056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d949-98bb-428d-8537-79c6abff3bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:10.158428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d949-98bb-428d-8537-79c6abff3bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:10.158793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064d949-98bb-428d-8537-79c6abff3bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:10.190514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d949-98bb-428d-8537-79c6abff3bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:10.193007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064d949-98bb-428d-8537-79c6abff3bb2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:10.215542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 826/1651] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:10.274252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2eab33-0fec-4555-ba74-6439c609d9bb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:10.290337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66597525-9c85-445f-ba8b-ef6124853298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:10.290337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66597525-9c85-445f-ba8b-ef6124853298 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:10.290337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66597525-9c85-445f-ba8b-ef6124853298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:10.290337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66597525-9c85-445f-ba8b-ef6124853298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:10.310257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66597525-9c85-445f-ba8b-ef6124853298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:10.311801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66597525-9c85-445f-ba8b-ef6124853298 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:10.338803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 826/1652] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:10.854241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf9203-6e4a-46ee-a220-6a389204b046 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:10.855187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf9203-6e4a-46ee-a220-6a389204b046 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:10.855554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf9203-6e4a-46ee-a220-6a389204b046 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:10.859832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 827/1653] 10.222.0.50 () {54 vars in 961 bytes} [Tue Jul 12 17:27:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:10.884215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9732-b9b8-40f7-8e81-63946222b06a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:10.884812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9732-b9b8-40f7-8e81-63946222b06a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:10.884980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c9732-b9b8-40f7-8e81-63946222b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:10.932829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d02c9732-b9b8-40f7-8e81-63946222b06a None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:10.935065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d02c9732-b9b8-40f7-8e81-63946222b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:11.111802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 827/1654] 10.222.0.50 () {58 vars in 1058 bytes} [Tue Jul 12 17:27:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:11.118085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818f95-de31-4669-999a-0595b399c517 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:11.118997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818f95-de31-4669-999a-0595b399c517 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:11.118997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d818f95-de31-4669-999a-0595b399c517 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:11.121247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 828/1655] 10.222.0.50 () {54 vars in 912 bytes} [Tue Jul 12 17:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:11.132336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:11.132635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:11.132918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:11.181265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:11.182680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:11.214683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 828/1656] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:27:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:11.223217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818f95-de31-4669-999a-0595b399c517 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:11.228804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8d818f95-de31-4669-999a-0595b399c517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:11.271239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:11.338703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d818f95-de31-4669-999a-0595b399c517 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:11.348735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:11.349802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:11.350231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:11.350534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:11.402623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:11.404245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:11.487165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 829/1657] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:12.238058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:12.239680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:12.260677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:12.265299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf472786-55bf-4e11-8047-ae4db523e4a6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:12.281553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:12.282643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:12.282753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:12.283294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] PATH_INFO: `/v3/projects/417f198f02394900974c6116e2f45fa5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:12.284882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417f198f02394900974c6116e2f45fa5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:12.286140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: WARNING py.warnings [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 17:27:12.286140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: warnings.warn(msg) Jul 12 17:27:12.286140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: Jul 12 17:27:12.287702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:12.385016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:12.386527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:12.409311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417f198f02394900974c6116e2f45fa5', 'request_id': 'req-b3f2e285-7211-4c7f-b661-4d3238fbea57'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.410660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6368f6-14f3-40ce-8b76-646ddd7b8798 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:12.447274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417f198f02394900974c6116e2f45fa5', 'request_id': 'req-b3f2e285-7211-4c7f-b661-4d3238fbea57'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.457974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417f198f02394900974c6116e2f45fa5', 'request_id': 'req-b3f2e285-7211-4c7f-b661-4d3238fbea57'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.510328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] The token cache is being invalidate because project 417f198f02394900974c6116e2f45fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:12.510756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.516946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.519527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 829/1658] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:12 2022] DELETE /identity/v3/projects/417f198f02394900974c6116e2f45fa5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:12.524301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:12.526992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:12.539829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:12.540981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:12.541398 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:12.541862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] PATH_INFO: `/v3/projects/e9f9a066392944adb64b1c9d5046b436` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:12.543801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f9a066392944adb64b1c9d5046b436)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:12.547278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:12.675101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f9a066392944adb64b1c9d5046b436', 'request_id': 'req-2ef91350-4725-44fc-837b-9742adfa32c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.696201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f9a066392944adb64b1c9d5046b436', 'request_id': 'req-2ef91350-4725-44fc-837b-9742adfa32c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.709481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2e285-7211-4c7f-b661-4d3238fbea57 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:12.712734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f9a066392944adb64b1c9d5046b436', 'request_id': 'req-2ef91350-4725-44fc-837b-9742adfa32c6'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.741714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] The token cache is being invalidate because project e9f9a066392944adb64b1c9d5046b436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:12.742272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.743932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:12.747546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 830/1659] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:12 2022] DELETE /identity/v3/projects/e9f9a066392944adb64b1c9d5046b436 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:27:12.751401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:12.753959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:12.858750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:12.862334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:12.862672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:12.863073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] PATH_INFO: `/v3/users/d7c819ab012941ae98bb3f8d8e0cd4f4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:12.866400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c819ab012941ae98bb3f8d8e0cd4f4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:12.871751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:12.886854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:12.920933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91350-4725-44fc-837b-9742adfa32c6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:12.932480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:12.933647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:12.934060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:12.934524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] PATH_INFO: `/v3/users/47721b22d76f44c1acb3f9df0aea99ba` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:12.936139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] RBAC: Authorizing `identity:delete_user(user_id=47721b22d76f44c1acb3f9df0aea99ba)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:12.938598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:12.969041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:12.989783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c819ab012941ae98bb3f8d8e0cd4f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.013445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c819ab012941ae98bb3f8d8e0cd4f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.040690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c819ab012941ae98bb3f8d8e0cd4f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.076270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47721b22d76f44c1acb3f9df0aea99ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.077302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47721b22d76f44c1acb3f9df0aea99ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.078034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47721b22d76f44c1acb3f9df0aea99ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.078207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c819ab012941ae98bb3f8d8e0cd4f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.082724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c819ab012941ae98bb3f8d8e0cd4f4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.088408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47721b22d76f44c1acb3f9df0aea99ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.095902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 830/1660] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:12 2022] DELETE /identity/v3/users/d7c819ab012941ae98bb3f8d8e0cd4f4 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:13.097163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:13.098681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:13.113034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-761dd836-8c2c-44e7-b685-b9001311352f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47721b22d76f44c1acb3f9df0aea99ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.136167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 831/1661] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:12 2022] DELETE /identity/v3/users/47721b22d76f44c1acb3f9df0aea99ba => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:13.209718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa36dc-47d2-4d08-85e3-717af57eb9b0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:13.352359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:13.362984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:13.363632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:13.364862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] PATH_INFO: `/v3/users/6421f45a7ac548918e8c81013720b3c0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:13.368230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6421f45a7ac548918e8c81013720b3c0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:13.373587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:13.520048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6421f45a7ac548918e8c81013720b3c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.536568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6421f45a7ac548918e8c81013720b3c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.553012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:13.580734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6421f45a7ac548918e8c81013720b3c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.616548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6421f45a7ac548918e8c81013720b3c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.621436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6421f45a7ac548918e8c81013720b3c0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:13.645907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 831/1662] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:13 2022] DELETE /identity/v3/users/6421f45a7ac548918e8c81013720b3c0 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:13.652388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:13.652870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:13.653181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:13.737754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:13.755154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:13.968451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 832/1663] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:14.095805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:14.098963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:14.235158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb0670-274a-4d8d-a908-f986f79d06f7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:14.239681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae393cf-0e98-462f-8f00-961936bde903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:14.240628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae393cf-0e98-462f-8f00-961936bde903 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:14.240953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae393cf-0e98-462f-8f00-961936bde903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:14.241205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae393cf-0e98-462f-8f00-961936bde903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:14.254712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae393cf-0e98-462f-8f00-961936bde903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:14.256369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae393cf-0e98-462f-8f00-961936bde903 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:14.271610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 832/1664] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:14.460273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:14.461829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:14.481371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcea41c-914f-48c1-affc-5b188708c2d2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:14.506265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:14.507688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:14.508434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:14.508434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] PATH_INFO: `/v3/projects/05725378dd714f078c080a060822c07f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:14.516572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=05725378dd714f078c080a060822c07f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:14.519718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:14.640238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05725378dd714f078c080a060822c07f', 'request_id': 'req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:14.653285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05725378dd714f078c080a060822c07f', 'request_id': 'req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:14.669171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05725378dd714f078c080a060822c07f', 'request_id': 'req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:14.687297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:14.711151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] The token cache is being invalidate because project 05725378dd714f078c080a060822c07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:14.711695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:14.715596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-79ce4fdb-72d8-493b-a078-5b2ceb2cdb3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:14.717606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 833/1665] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:14 2022] DELETE /identity/v3/projects/05725378dd714f078c080a060822c07f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:14.724636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e13a6-79af-4235-ab64-310081378098 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:14.724636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e13a6-79af-4235-ab64-310081378098 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:14.725294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e13a6-79af-4235-ab64-310081378098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:14.760698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7a4e13a6-79af-4235-ab64-310081378098 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:14.761983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a4e13a6-79af-4235-ab64-310081378098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:14.960751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 833/1666] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:14.962154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323d65-cca6-45c7-a032-958934c85285 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:14.962413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323d65-cca6-45c7-a032-958934c85285 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:14.962695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323d65-cca6-45c7-a032-958934c85285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.007391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b0323d65-cca6-45c7-a032-958934c85285 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:15.009039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b0323d65-cca6-45c7-a032-958934c85285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:15.020269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 834/1667] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:15.024592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e13a6-79af-4235-ab64-310081378098 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:15.036115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e13a6-79af-4235-ab64-310081378098 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:15.042009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:15.042997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:15.043123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:15.043322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.044406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:15.044934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:15.046792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:15.062925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 834/1668] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:15.067989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323d65-cca6-45c7-a032-958934c85285 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:15.081019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323d65-cca6-45c7-a032-958934c85285 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:15.090693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:15.091391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:15.091671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:15.091944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.096307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:15.101235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:15.172025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 835/1669] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:15 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:15.177821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:15.207970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dec7a-c8f0-4004-97fb-c4f85c54d022 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:15.413927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:15.414749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:15.415269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:15.415653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.416765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:15.428013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:15.462912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:15.472218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 835/1670] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:15 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:15.475531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:15.497075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114eca0-2096-4d5e-9038-b726ac246c40 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:15.513968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:15.514936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:15.515975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:15.516268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.517127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:15.522565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:15.553399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 836/1671] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:15.558207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:15.606724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3395d07-7019-447b-bb9a-10de6d0a2177 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:15.623757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7445144-07e9-445e-b9f7-1de2e85796de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:15.626180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445144-07e9-445e-b9f7-1de2e85796de admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:15.631610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445144-07e9-445e-b9f7-1de2e85796de admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:15.631610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7445144-07e9-445e-b9f7-1de2e85796de admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.636783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7445144-07e9-445e-b9f7-1de2e85796de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:15.638555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7445144-07e9-445e-b9f7-1de2e85796de admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:15.686332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 836/1672] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:15.691131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:15.715238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84ef52-89db-4fbc-a1a3-fc2116c4d49f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:15.741118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:15.742831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:15.743120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:15.743408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] PATH_INFO: `/v3/projects/a05e7366264c461caf5f2d67a74b5b8e/users/1ae18204db634c23bb59ba92cc0a4e8d/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.784091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05e7366264c461caf5f2d67a74b5b8e, user_id=1ae18204db634c23bb59ba92cc0a4e8d, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:15.790330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:15.847437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 837/1673] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:15 2022] PUT /identity/v3/projects/a05e7366264c461caf5f2d67a74b5b8e/users/1ae18204db634c23bb59ba92cc0a4e8d/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:15.860984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:15.861632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:15.861963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:15.973040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] MFA Rules not processed for user `1ae18204db634c23bb59ba92cc0a4e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:15.981967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:16.169351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 837/1674] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:16.175563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:16.185534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:16.192098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:16.371053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ad0a7-5038-414b-b5b1-13cb0ce85e0b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:16.375331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8aac30-846a-4795-ae08-fdaf2313f012 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:16.397069 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:16.397995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:16.398309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:16.398591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:16.399389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:16.399925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:16.400823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:16.401102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:16.401385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] PATH_INFO: `/v3/projects/289104ca8b2a4fee8cd66e19d39aff83` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:16.401942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:16.411146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=289104ca8b2a4fee8cd66e19d39aff83)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:16.411146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:16.489904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 838/1675] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:16 2022] POST /identity/v3/projects => generated 377 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:16.494493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:16.530329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '289104ca8b2a4fee8cd66e19d39aff83', 'request_id': 'req-151897f9-308d-4d52-81f4-81d93f68a8d7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.543024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '289104ca8b2a4fee8cd66e19d39aff83', 'request_id': 'req-151897f9-308d-4d52-81f4-81d93f68a8d7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.566999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '289104ca8b2a4fee8cd66e19d39aff83', 'request_id': 'req-151897f9-308d-4d52-81f4-81d93f68a8d7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.596330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] The token cache is being invalidate because project 289104ca8b2a4fee8cd66e19d39aff83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:16.597644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.597939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.603147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 838/1676] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:16 2022] DELETE /identity/v3/projects/289104ca8b2a4fee8cd66e19d39aff83 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:16.604256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:16.607858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:16.642244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:16.679902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e6747-d137-4538-b1db-fba99d6e3fd8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:16.717407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:16.789082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151897f9-308d-4d52-81f4-81d93f68a8d7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:16.809340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:16.810642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:16.810922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:16.811197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] PATH_INFO: `/v3/users/8a39c802d1d24a41847f540ea55846d9` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:16.812708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a39c802d1d24a41847f540ea55846d9)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:16.815336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:16.850872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20034469-ad6f-4c17-a25f-0fdc39577284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:16.851927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034469-ad6f-4c17-a25f-0fdc39577284 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:16.853118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034469-ad6f-4c17-a25f-0fdc39577284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:16.853645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20034469-ad6f-4c17-a25f-0fdc39577284 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:16.854543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034469-ad6f-4c17-a25f-0fdc39577284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:16.859381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20034469-ad6f-4c17-a25f-0fdc39577284 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:16.903660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 839/1677] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:16 2022] POST /identity/v3/users => generated 295 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:16.907261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:16.907902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:16.909357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:16.934499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a39c802d1d24a41847f540ea55846d9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.944058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:16.948515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:16.956531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a39c802d1d24a41847f540ea55846d9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.979395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 840/1678] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:16.979616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a39c802d1d24a41847f540ea55846d9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.980838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:16.983927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:16.996896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a39c802d1d24a41847f540ea55846d9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:16.999247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c93ebd45-8235-4ba3-9b1b-8ef8e893ec8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a39c802d1d24a41847f540ea55846d9'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:17.011079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bf2aa-1b7a-4b0d-954b-5f634572fb20 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.017881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 839/1679] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:16 2022] DELETE /identity/v3/users/8a39c802d1d24a41847f540ea55846d9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:17.022797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.023146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.023433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.048886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c406198-791a-462e-b7df-9ab5ce2eb372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:17.049620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c406198-791a-462e-b7df-9ab5ce2eb372 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.049907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c406198-791a-462e-b7df-9ab5ce2eb372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.050187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c406198-791a-462e-b7df-9ab5ce2eb372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.056703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c406198-791a-462e-b7df-9ab5ce2eb372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:17.062869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c406198-791a-462e-b7df-9ab5ce2eb372 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:17.067320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:17.068558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:17.100397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 841/1680] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:17.100397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5524-40eb-4ceb-b99a-6fa85f232262 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.100819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5524-40eb-4ceb-b99a-6fa85f232262 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.100994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d5524-40eb-4ceb-b99a-6fa85f232262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.147920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0f4d5524-40eb-4ceb-b99a-6fa85f232262 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:17.149214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0f4d5524-40eb-4ceb-b99a-6fa85f232262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:17.253623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 840/1681] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:17.255719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.259289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:17.295231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa19439-ad5a-4ce1-bd84-116b47e8cad5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.316290 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:17.317222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.317507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.317899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] PATH_INFO: `/v3/projects/69b7ad095a8d40c28b033eb06cd6ee3e/users/aabc9c3584484aaeaa802aaf14e3d392/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.334879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 842/1682] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:17.335922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d5524-40eb-4ceb-b99a-6fa85f232262 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.357318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b7ad095a8d40c28b033eb06cd6ee3e, user_id=aabc9c3584484aaeaa802aaf14e3d392, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:17.365955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:17.366852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d5524-40eb-4ceb-b99a-6fa85f232262 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.371908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:17.372797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.372938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.373187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.373930 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:17.374240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:17.377962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:17.393631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 843/1683] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:17.402962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 841/1684] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:17 2022] PUT /identity/v3/projects/69b7ad095a8d40c28b033eb06cd6ee3e/users/aabc9c3584484aaeaa802aaf14e3d392/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:17.403101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.409834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.416936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:17.418694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceae2f-b5d2-446a-b621-6c36b7c4c8e3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.529932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:17.531040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.531530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.539794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cebc8-3410-4b6a-ae49-c7673cacc13e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.540259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.541145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:17.544182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:17.546931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:17.547775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.549231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.549231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.549694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:17.551379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:17.581858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 842/1685] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:17.583089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.593077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:17.626531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 844/1686] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:17 2022] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:17.627618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.629580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:17.642128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:17.719410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c61b85-f83e-4661-a054-565effc3ab7f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.749746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae9ef-7dfd-4e1c-a09b-f29a1ae9be9d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.756397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:17.757313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.757594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.757869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] PATH_INFO: `/v3/projects/5fbbd30fa8014e12a10a310efbe29ea6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.761634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbbd30fa8014e12a10a310efbe29ea6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:17.765019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:17.839300 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:17.839986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:17.840269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:17.840571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:17.862754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbbd30fa8014e12a10a310efbe29ea6', 'request_id': 'req-743cbea0-7587-49cf-a9d5-657049a7a67a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:17.864475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:17.865962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:17.881430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbbd30fa8014e12a10a310efbe29ea6', 'request_id': 'req-743cbea0-7587-49cf-a9d5-657049a7a67a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:17.893755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbbd30fa8014e12a10a310efbe29ea6', 'request_id': 'req-743cbea0-7587-49cf-a9d5-657049a7a67a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:17.898785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 843/1687] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:17.899658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.914863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730b55e-2c36-44f8-b11f-06cca1bed5de service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:17.929619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] The token cache is being invalidate because project 5fbbd30fa8014e12a10a310efbe29ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:17.930076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:17.931554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:17.937096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 845/1688] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:17 2022] DELETE /identity/v3/projects/5fbbd30fa8014e12a10a310efbe29ea6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:17.939506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:17.942204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:18.052810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:18.055026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.055314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.055611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] PATH_INFO: `/v3/projects/69b7ad095a8d40c28b033eb06cd6ee3e/users/aabc9c3584484aaeaa802aaf14e3d392/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.061320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b7ad095a8d40c28b033eb06cd6ee3e, user_id=aabc9c3584484aaeaa802aaf14e3d392, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:18.066344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:18.070705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cbea0-7587-49cf-a9d5-657049a7a67a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:18.074532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:18.082051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc515a-c230-4216-9407-78b34fa4a53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:18.082945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc515a-c230-4216-9407-78b34fa4a53e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.083326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc515a-c230-4216-9407-78b34fa4a53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.083702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc515a-c230-4216-9407-78b34fa4a53e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.084906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc515a-c230-4216-9407-78b34fa4a53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:18.090796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc515a-c230-4216-9407-78b34fa4a53e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:18.095109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 844/1689] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:17 2022] PUT /identity/v3/projects/69b7ad095a8d40c28b033eb06cd6ee3e/users/aabc9c3584484aaeaa802aaf14e3d392/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:18.097224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:18.108381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:18.149843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 846/1690] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:17 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:18.157424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac752fc-1cc6-418a-b264-54314a204279 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.157708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac752fc-1cc6-418a-b264-54314a204279 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.158516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac752fc-1cc6-418a-b264-54314a204279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.218884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eac752fc-1cc6-418a-b264-54314a204279 None None] MFA Rules not processed for user `aabc9c3584484aaeaa802aaf14e3d392`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:18.220128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eac752fc-1cc6-418a-b264-54314a204279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:18.257420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c47285-a5fe-4732-8d91-ccb253496f56 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:18.263577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:18.271359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:18.272307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.274728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.275020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] PATH_INFO: `/v3/users/8fb1271fa674443288c681e1b43a66a4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.277538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb1271fa674443288c681e1b43a66a4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:18.282000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:18.370243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 847/1691] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:18.382268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac752fc-1cc6-418a-b264-54314a204279 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:18.394187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb1271fa674443288c681e1b43a66a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:18.405598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac752fc-1cc6-418a-b264-54314a204279 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:18.415838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:18.416756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.418280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb1271fa674443288c681e1b43a66a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:18.426266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.426953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.433046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:18.441422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:18.458403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb1271fa674443288c681e1b43a66a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:18.480870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 848/1692] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:18.482151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:18.487712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb1271fa674443288c681e1b43a66a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:18.489027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb1271fa674443288c681e1b43a66a4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:18.490535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:18.505317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 845/1693] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:18 2022] DELETE /identity/v3/users/8fb1271fa674443288c681e1b43a66a4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:18.507078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:18.514501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:18.690818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd52d7-1768-423e-9884-1b55e9a95edf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:18.725868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86572a-0c0e-4107-b107-ae12220d03d0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:18.736953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:18.738260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.738643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.738989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.741580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:18.744283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:18.774428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 846/1694] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:18.775997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:18.800097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb7fc0-7b68-4d86-b952-8209fcd5cf5f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:18.813689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b95ea2-dc01-4915-b192-f79e4af89779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:18.814695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95ea2-dc01-4915-b192-f79e4af89779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.814982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95ea2-dc01-4915-b192-f79e4af89779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.815351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b95ea2-dc01-4915-b192-f79e4af89779 admin admin] PATH_INFO: `/v3/projects/e416f93d9b6846bda88607db83857ffb/users/080fa2d193c34373955e4a9197288cae/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.819740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:18.820711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:18.821259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.822795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.823086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.837188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:18.849474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b95ea2-dc01-4915-b192-f79e4af89779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e416f93d9b6846bda88607db83857ffb, user_id=080fa2d193c34373955e4a9197288cae, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:18.856200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b95ea2-dc01-4915-b192-f79e4af89779 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:18.893103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 847/1695] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:18 2022] PUT /identity/v3/projects/e416f93d9b6846bda88607db83857ffb/users/080fa2d193c34373955e4a9197288cae/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:18.896724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2883-f844-44df-9570-aecda154ae9f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:18.897054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2883-f844-44df-9570-aecda154ae9f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:18.897341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa2883-f844-44df-9570-aecda154ae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:18.958384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-edfa2883-f844-44df-9570-aecda154ae9f None None] MFA Rules not processed for user `080fa2d193c34373955e4a9197288cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:18.961194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-edfa2883-f844-44df-9570-aecda154ae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:18.999055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:19.001074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:19.026637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 849/1696] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:19.097836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 848/1697] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:19.102245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:19.118127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f92cb6-7514-4490-8db0-44b7d05cc569 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:19.130653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:19.227411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:19.228122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:19.228405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:19.228682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:19.229395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:19.231405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:19.285873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 850/1698] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:19 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:19.290407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2883-f844-44df-9570-aecda154ae9f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:19.305322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa2883-f844-44df-9570-aecda154ae9f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:19.423136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:19.425115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:19.465960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:19.466909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:19.467198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:19.467489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:19.468199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:19.470463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:19.514051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 849/1699] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:19 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:19.515111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:19.538381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcdefc-7a9f-4449-8b37-6090f5abce4f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:19.550178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:19.551018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:19.551303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:19.551575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:19.555061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:19.557534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:19.560209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f9a0b-f06d-434f-804a-f70a23b6b063 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:19.583183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:19.584148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:19.584458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:19.584833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] PATH_INFO: `/v3/projects/bfec9b4372e9483584e8ae2b99544223` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:19.586494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfec9b4372e9483584e8ae2b99544223)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:19.592286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:19.594422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 850/1700] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:19.603214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:19.638415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff4681-c55b-41ae-8c89-e4e97186f2cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:19.658547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:19.659285 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:19.659574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:19.663621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:19.664576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:19.668523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:19.719563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 851/1701] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:19.721687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:19.730642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfec9b4372e9483584e8ae2b99544223', 'request_id': 'req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:19.765922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111bfd3-2893-4161-af06-bb213868034a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:19.766894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfec9b4372e9483584e8ae2b99544223', 'request_id': 'req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:19.810237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfec9b4372e9483584e8ae2b99544223', 'request_id': 'req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:19.841734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] The token cache is being invalidate because project bfec9b4372e9483584e8ae2b99544223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:19.842338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:19.843143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-bc6480f8-fb12-4ff9-acf0-143fc0ac7c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:19.845424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 851/1702] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:19 2022] DELETE /identity/v3/projects/bfec9b4372e9483584e8ae2b99544223 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:27:19.850446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496347-8f80-4aab-be2b-d2748eec7b12 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:19.851251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496347-8f80-4aab-be2b-d2748eec7b12 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:19.851652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5496347-8f80-4aab-be2b-d2748eec7b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:19.899198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a5496347-8f80-4aab-be2b-d2748eec7b12 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:19.900482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a5496347-8f80-4aab-be2b-d2748eec7b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:19.913378 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:19.970695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:19.981769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e986c-45c7-4f6b-b3f6-1989980ed475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:19.984616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e986c-45c7-4f6b-b3f6-1989980ed475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:19.985338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e986c-45c7-4f6b-b3f6-1989980ed475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:19.987131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e986c-45c7-4f6b-b3f6-1989980ed475 admin admin] PATH_INFO: `/v3/projects/57aab6324b2148a6aee492005b820c4a/users/bea774e4f5314f85a6a25d17abf3eee4/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.019262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e986c-45c7-4f6b-b3f6-1989980ed475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aab6324b2148a6aee492005b820c4a, user_id=bea774e4f5314f85a6a25d17abf3eee4, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:20.022854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e986c-45c7-4f6b-b3f6-1989980ed475 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:20.046770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 852/1703] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:19 2022] PUT /identity/v3/projects/57aab6324b2148a6aee492005b820c4a/users/bea774e4f5314f85a6a25d17abf3eee4/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:20.055321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 852/1704] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:20.059871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16a64-a3c7-47d2-9edc-bf9c44cab573 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:20.060162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16a64-a3c7-47d2-9edc-bf9c44cab573 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:20.060442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16a64-a3c7-47d2-9edc-bf9c44cab573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.061417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:20.061871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:20.063041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.108991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-83e16a64-a3c7-47d2-9edc-bf9c44cab573 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:20.110405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83e16a64-a3c7-47d2-9edc-bf9c44cab573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:20.145788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] MFA Rules not processed for user `bea774e4f5314f85a6a25d17abf3eee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:20.149163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:20.287832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 853/1705] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:20.295185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e16a64-a3c7-47d2-9edc-bf9c44cab573 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:20.314254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e16a64-a3c7-47d2-9edc-bf9c44cab573 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:20.314929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 853/1706] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:20.320010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:20.323835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:20.332631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:20.333335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:20.334000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:20.334000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.334661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:20.334971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:20.344796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:20.356275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a886c81-28ba-429f-986a-2b492f73287f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:20.370980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:20.372218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:20.372707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:20.373140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.374007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:20.380059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:20.382793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 854/1707] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:20.386333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:20.415881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2268f-76f5-4b9d-ae8d-44a2a4d79eb5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:20.438785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:20.443390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:20.443749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:20.444039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.447047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:20.450795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:20.461126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 854/1708] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:20 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:20.464861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:20.552931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 855/1709] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:20 2022] POST /identity/v3/projects => generated 405 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:27:20.553845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:20.557812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:20.700267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccb15f-cc00-442a-8254-69356f0ebc3b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:20.753489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0a1cd-209b-41ba-9b8d-4acbf43b5df7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:20.770806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:20.771671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:20.771936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:20.772337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] PATH_INFO: `/v3/projects/f96aaab15e0a4aab8bda3622c8879b13` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.773463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96aaab15e0a4aab8bda3622c8879b13)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:20.775442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:20.814929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:20.866520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:20.888666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:20.889391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:20.889675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:20.889951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:20.890691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:20.894499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:20.903797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96aaab15e0a4aab8bda3622c8879b13', 'request_id': 'req-36f4f207-2a36-462a-bf66-7862b9fc7e93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:20.930509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96aaab15e0a4aab8bda3622c8879b13', 'request_id': 'req-36f4f207-2a36-462a-bf66-7862b9fc7e93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:20.942680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96aaab15e0a4aab8bda3622c8879b13', 'request_id': 'req-36f4f207-2a36-462a-bf66-7862b9fc7e93'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:20.954250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 855/1710] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:20 2022] POST /identity/v3/users => generated 300 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:27:20.954250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:20.989149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] The token cache is being invalidate because project f96aaab15e0a4aab8bda3622c8879b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:20.989495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:20.990615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:20.997360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 856/1711] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:20 2022] DELETE /identity/v3/projects/f96aaab15e0a4aab8bda3622c8879b13 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:20.997360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.000340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:21.002643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374636e-b1cb-4102-a1d2-15a18166e57b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.143786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48512a-d469-48e0-917d-caf91e17afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.144498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48512a-d469-48e0-917d-caf91e17afc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.144783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48512a-d469-48e0-917d-caf91e17afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.145060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48512a-d469-48e0-917d-caf91e17afc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.146165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48512a-d469-48e0-917d-caf91e17afc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.152591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48512a-d469-48e0-917d-caf91e17afc5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.194898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4f207-2a36-462a-bf66-7862b9fc7e93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.211074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.211928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.212173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.212456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.213210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.215230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.216383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 856/1712] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:20 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:21.224297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c186af0-3777-44d5-99cf-58f5e9411bf3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.224606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c186af0-3777-44d5-99cf-58f5e9411bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.224885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c186af0-3777-44d5-99cf-58f5e9411bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.239611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 857/1713] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:21.240612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.247589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:21.280531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b1214-555f-48f3-b76f-c399fe9c6db5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.282130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3c186af0-3777-44d5-99cf-58f5e9411bf3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:21.284590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3c186af0-3777-44d5-99cf-58f5e9411bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:21.296192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.296912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.297286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.297526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.298576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.300701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.315949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 858/1714] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:21.317097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.326452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 857/1715] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:21.327477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c186af0-3777-44d5-99cf-58f5e9411bf3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.343756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb127-6768-4b94-b140-053e00e4fa84 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.349207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c186af0-3777-44d5-99cf-58f5e9411bf3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.351909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb177340-5dca-4889-a42d-574bc958c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.353040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb177340-5dca-4889-a42d-574bc958c331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.353433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb177340-5dca-4889-a42d-574bc958c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.353808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb177340-5dca-4889-a42d-574bc958c331 admin admin] PATH_INFO: `/v3/projects/441133929d824c0ba86e7e4cc2aec136/users/f7b0289e8b7f4957b157612276282e61/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.366201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.367813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.368104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.368374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.369457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.371321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.380504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb177340-5dca-4889-a42d-574bc958c331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=441133929d824c0ba86e7e4cc2aec136, user_id=f7b0289e8b7f4957b157612276282e61, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.384731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb177340-5dca-4889-a42d-574bc958c331 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.408787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 858/1716] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:21.413832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 859/1717] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:21 2022] PUT /identity/v3/projects/441133929d824c0ba86e7e4cc2aec136/users/f7b0289e8b7f4957b157612276282e61/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:21.418334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13e006-5b47-4aa5-8935-e8bf512b327a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.418770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13e006-5b47-4aa5-8935-e8bf512b327a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.419173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13e006-5b47-4aa5-8935-e8bf512b327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.427147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.455481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea4908-b604-48fb-a295-5eee91e66885 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.466586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ae13e006-5b47-4aa5-8935-e8bf512b327a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:21.470615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae13e006-5b47-4aa5-8935-e8bf512b327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:21.605623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.606714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.607001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.607265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] PATH_INFO: `/v3/projects/ba0e074242c1493f8cf9e6996bba0c96/users/33c487345d51496fab899ea31371be6c/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.640569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 860/1718] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:21.641728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13e006-5b47-4aa5-8935-e8bf512b327a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.659464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0e074242c1493f8cf9e6996bba0c96, user_id=33c487345d51496fab899ea31371be6c, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.662192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.681256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13e006-5b47-4aa5-8935-e8bf512b327a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.697493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8744a-2731-4a32-a7a7-ec7ec2d88249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.698214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8744a-2731-4a32-a7a7-ec7ec2d88249 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.699797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8744a-2731-4a32-a7a7-ec7ec2d88249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.700737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8744a-2731-4a32-a7a7-ec7ec2d88249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.702316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 859/1719] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:21 2022] PUT /identity/v3/projects/ba0e074242c1493f8cf9e6996bba0c96/users/33c487345d51496fab899ea31371be6c/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:21.704284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8744a-2731-4a32-a7a7-ec7ec2d88249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.709071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8744a-2731-4a32-a7a7-ec7ec2d88249 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.713549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.734981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 861/1720] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:21.740998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2237a-b038-4fbb-83af-912bb388c490 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.741373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2237a-b038-4fbb-83af-912bb388c490 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.741595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2237a-b038-4fbb-83af-912bb388c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.776377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:21.800678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:21.815898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-77b2237a-b038-4fbb-83af-912bb388c490 None None] MFA Rules not processed for user `33c487345d51496fab899ea31371be6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:21.817023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-77b2237a-b038-4fbb-83af-912bb388c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:21.824546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b64f75-7574-4e38-925e-16c54b20642f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.837324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.838038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.838393 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.838628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.840665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:21.840987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.843205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.879828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 860/1721] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:21.883123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.897778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0439e-ce0f-4130-9234-77b29b223d39 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.917459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:21.918623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:21.918920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:21.928499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] PATH_INFO: `/v3/projects/441133929d824c0ba86e7e4cc2aec136/users/f7b0289e8b7f4957b157612276282e61/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:21.933197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=441133929d824c0ba86e7e4cc2aec136, user_id=f7b0289e8b7f4957b157612276282e61, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:21.937528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:21.942692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 862/1722] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:21.942692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2237a-b038-4fbb-83af-912bb388c490 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:21.969516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2237a-b038-4fbb-83af-912bb388c490 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:21.971090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 861/1723] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:21 2022] PUT /identity/v3/projects/441133929d824c0ba86e7e4cc2aec136/users/f7b0289e8b7f4957b157612276282e61/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:21.972608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.028231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00000cb-d3b1-4789-bfc6-7270b5dfc019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.028820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00000cb-d3b1-4789-bfc6-7270b5dfc019 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.029111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00000cb-d3b1-4789-bfc6-7270b5dfc019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.029384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00000cb-d3b1-4789-bfc6-7270b5dfc019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.030132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00000cb-d3b1-4789-bfc6-7270b5dfc019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.032461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00000cb-d3b1-4789-bfc6-7270b5dfc019 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.072052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 863/1724] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:21 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:22.073863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc16fa-944a-40b7-9f30-881f48068e34 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.074327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc16fa-944a-40b7-9f30-881f48068e34 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.075214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc16fa-944a-40b7-9f30-881f48068e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.117042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526411ad-4af9-48cf-b415-18abb87848eb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.117398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-09dc16fa-944a-40b7-9f30-881f48068e34 None None] MFA Rules not processed for user `f7b0289e8b7f4957b157612276282e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:22.119053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-09dc16fa-944a-40b7-9f30-881f48068e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:22.217228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 864/1725] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:22.218305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc16fa-944a-40b7-9f30-881f48068e34 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.241796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:22.250361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.251020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.251403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.252620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.255046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.259083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.312165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 862/1726] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:21 2022] POST /identity/v3/projects => generated 405 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:22.313068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.316724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:22.347665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc16fa-944a-40b7-9f30-881f48068e34 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.470697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:22.505348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aed143-ec97-4b1c-a5d2-72ce0733eafb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.510940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.511894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.511995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.512178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.512572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.513769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.514227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.515306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.518121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.525832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.576105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 865/1727] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:22 2022] POST /identity/v3/users => generated 294 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:22.576105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.605995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad8cd5-b271-417f-8dd3-4493cc57ad1e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.614425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.615457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.615851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.616261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.617017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.621922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.670650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 866/1728] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:22 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:22.670650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.676776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:22.697932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acc7c8-8f08-4e6b-b9e4-87531ac3b5fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.699601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.701997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.702481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.702731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.703173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.703450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.705657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:22.719441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 863/1729] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:22.721244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.747502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc9ef1-e2df-438e-9755-c790e3a39c7d service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.754008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.755482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.756190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.756565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.757292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.759605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.798892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 864/1730] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:22.800820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.827660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642a4d8-72c1-43ae-8df6-64863b816fce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.843615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.845284 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.849879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa58b2-bc12-422f-9df2-9b617bfdde5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.851231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa58b2-bc12-422f-9df2-9b617bfdde5a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.851629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa58b2-bc12-422f-9df2-9b617bfdde5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.851791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa58b2-bc12-422f-9df2-9b617bfdde5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.854797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa58b2-bc12-422f-9df2-9b617bfdde5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.856615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa58b2-bc12-422f-9df2-9b617bfdde5a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.861188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 867/1731] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:22.867974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.884169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e72b2d-f1bf-4449-a3de-fa5fbb7cd8be service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.886774 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 865/1732] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:22.894593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9ee48-9dbd-474e-9fef-9a91cbf95c6e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.894760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9ee48-9dbd-474e-9fef-9a91cbf95c6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.895035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9ee48-9dbd-474e-9fef-9a91cbf95c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.896337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.897301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.897707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.898200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.899130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:22.901629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:22.927846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 868/1733] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:22.929955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:22.953060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b8bb-a3c6-4a74-971d-326c0abb4395 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:22.973703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:22.974732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:22.975092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:22.975537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] PATH_INFO: `/v3/projects/f9339a9780334571b485d4f0812a3d72/users/916c28f69d144e55bc23ccb2ed650f98/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:22.983493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00d9ee48-9dbd-474e-9fef-9a91cbf95c6e None None] MFA Rules not processed for user `190092274f6843959bf16a569a388ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:22.985883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00d9ee48-9dbd-474e-9fef-9a91cbf95c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:23.005157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:23.018166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9339a9780334571b485d4f0812a3d72, user_id=916c28f69d144e55bc23ccb2ed650f98, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:23.021496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:23.061427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 869/1734] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:22 2022] PUT /identity/v3/projects/f9339a9780334571b485d4f0812a3d72/users/916c28f69d144e55bc23ccb2ed650f98/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:23.065612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:23.176646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 866/1735] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:23.177628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9ee48-9dbd-474e-9fef-9a91cbf95c6e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:23.208364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9ee48-9dbd-474e-9fef-9a91cbf95c6e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:23.222244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:23.223228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:23.223517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:23.223842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:23.224528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:23.228098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:23.235100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3b58-a9e7-4333-bc96-670f4f65b378 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:23.250402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f1a79-3bc4-4d4f-9bf4-917a2eda3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:23.251462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f1a79-3bc4-4d4f-9bf4-917a2eda3bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:23.252000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f1a79-3bc4-4d4f-9bf4-917a2eda3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:23.252403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f1a79-3bc4-4d4f-9bf4-917a2eda3bbb admin admin] PATH_INFO: `/v3/projects/c7844f0e58004357958ede6b47998691/users/05c1ca1d25b548d1b4a1c5b2e8e357fc/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:23.269497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 867/1736] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:23.274964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:23.285531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:23.296609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f1a79-3bc4-4d4f-9bf4-917a2eda3bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7844f0e58004357958ede6b47998691, user_id=05c1ca1d25b548d1b4a1c5b2e8e357fc, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:23.299477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f1a79-3bc4-4d4f-9bf4-917a2eda3bbb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:23.347803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 870/1737] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:23 2022] PUT /identity/v3/projects/c7844f0e58004357958ede6b47998691/users/05c1ca1d25b548d1b4a1c5b2e8e357fc/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:23.349283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b20d-713d-455c-b4c6-c6e35c968656 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:23.349635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b20d-713d-455c-b4c6-c6e35c968656 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:23.349982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b20d-713d-455c-b4c6-c6e35c968656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:23.420494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8200b20d-713d-455c-b4c6-c6e35c968656 None None] MFA Rules not processed for user `7e5a33e74f604488b83efeec71ca7981`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:23.422752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8200b20d-713d-455c-b4c6-c6e35c968656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:23.445009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:23.522537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f25a2f-7bf3-4a93-a958-f08226729adf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:23.592961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 871/1738] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:23.594263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b20d-713d-455c-b4c6-c6e35c968656 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:23.750170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b20d-713d-455c-b4c6-c6e35c968656 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:23.767499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53918a-8da6-4107-993d-9613e0c775ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:23.769328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53918a-8da6-4107-993d-9613e0c775ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:23.769702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53918a-8da6-4107-993d-9613e0c775ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:23.770048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53918a-8da6-4107-993d-9613e0c775ec admin admin] PATH_INFO: `/v3/projects/f9339a9780334571b485d4f0812a3d72/users/916c28f69d144e55bc23ccb2ed650f98/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:23.773216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53918a-8da6-4107-993d-9613e0c775ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9339a9780334571b485d4f0812a3d72, user_id=916c28f69d144e55bc23ccb2ed650f98, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:23.777905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53918a-8da6-4107-993d-9613e0c775ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:23.795044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:23.805396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:23.806190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:23.806529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:23.806806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:23.819429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 872/1739] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:23 2022] PUT /identity/v3/projects/f9339a9780334571b485d4f0812a3d72/users/916c28f69d144e55bc23ccb2ed650f98/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:23.820473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e00e47-eec9-4c95-a191-cd65042d5b05 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:23.820473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e00e47-eec9-4c95-a191-cd65042d5b05 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:23.820829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e00e47-eec9-4c95-a191-cd65042d5b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:23.871293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-07e00e47-eec9-4c95-a191-cd65042d5b05 None None] MFA Rules not processed for user `05c1ca1d25b548d1b4a1c5b2e8e357fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:23.872717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-07e00e47-eec9-4c95-a191-cd65042d5b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:23.947359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:23.949862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:23.973132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 868/1740] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:23.974992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:23.978379 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:24.011581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bca9f-ea32-489d-9f78-0a756673a602 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:24.036561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 873/1741] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:24.039384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dfa02-cb27-477a-8dbe-f590973d4a90 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.040464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dfa02-cb27-477a-8dbe-f590973d4a90 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.042459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dfa02-cb27-477a-8dbe-f590973d4a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:24.106016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3c3dfa02-cb27-477a-8dbe-f590973d4a90 None None] MFA Rules not processed for user `916c28f69d144e55bc23ccb2ed650f98`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:24.107703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3c3dfa02-cb27-477a-8dbe-f590973d4a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:24.188683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:24.189403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.189685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.190367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:24.249649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:24.286710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 874/1742] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:24.287320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dfa02-cb27-477a-8dbe-f590973d4a90 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:24.347834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:24.351196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:24.390922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 869/1743] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:24.392343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:24.411228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dfa02-cb27-477a-8dbe-f590973d4a90 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:24.424857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:24.425571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.425864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.426159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:24.428202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:24.483871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:24.524694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae21f2-030b-4cba-9302-5ee968172592 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:24.538922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:24.539802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.540618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.541525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:24.544214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:24.548746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:24.562822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:24.564100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:24.576381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 875/1744] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:24.577270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:24.609831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28ab08-0783-4e99-98c4-e558f43ced07 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:24.618943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cbaa1-524b-4767-9043-2719e3895e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:24.619880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbaa1-524b-4767-9043-2719e3895e3e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.620109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbaa1-524b-4767-9043-2719e3895e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.620396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cbaa1-524b-4767-9043-2719e3895e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:24.642339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 870/1745] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:24 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:24.643689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cbaa1-524b-4767-9043-2719e3895e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:24.644976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:24.647398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cbaa1-524b-4767-9043-2719e3895e3e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:24.704234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 876/1746] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:24.709104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da9410-06f1-4602-bf73-e5ac5076fa2f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.712640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da9410-06f1-4602-bf73-e5ac5076fa2f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.716587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da9410-06f1-4602-bf73-e5ac5076fa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:24.821576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-04da9410-06f1-4602-bf73-e5ac5076fa2f None None] MFA Rules not processed for user `0ffbfc994b03410faf1a124ac7d4cc72`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:24.823984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-04da9410-06f1-4602-bf73-e5ac5076fa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:24.895770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ec7b-e76e-4376-bccc-5eef2d2c59c1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:24.917278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8251ae9-26d6-46ac-a366-41af20e37d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:24.918132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251ae9-26d6-46ac-a366-41af20e37d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.918633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251ae9-26d6-46ac-a366-41af20e37d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.919173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8251ae9-26d6-46ac-a366-41af20e37d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:24.920136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8251ae9-26d6-46ac-a366-41af20e37d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:24.926103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8251ae9-26d6-46ac-a366-41af20e37d19 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:24.977553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 871/1747] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:24 2022] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:24.983278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb5cd-992d-49b9-80b8-9d7e8dbeeacd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:24.984907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb5cd-992d-49b9-80b8-9d7e8dbeeacd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:24.985446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eb5cd-992d-49b9-80b8-9d7e8dbeeacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:25.054178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 877/1748] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:25.058695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da9410-06f1-4602-bf73-e5ac5076fa2f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:25.087305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da9410-06f1-4602-bf73-e5ac5076fa2f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:25.090566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-db9eb5cd-992d-49b9-80b8-9d7e8dbeeacd None None] MFA Rules not processed for user `58298868d67d4aa584a9fed53e4358a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:25.092119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-db9eb5cd-992d-49b9-80b8-9d7e8dbeeacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:25.103746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db203484-2f3f-44bb-8337-e1a55cbf8c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:25.104491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db203484-2f3f-44bb-8337-e1a55cbf8c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:25.104727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db203484-2f3f-44bb-8337-e1a55cbf8c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:25.105001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db203484-2f3f-44bb-8337-e1a55cbf8c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:25.105749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db203484-2f3f-44bb-8337-e1a55cbf8c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:25.107808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db203484-2f3f-44bb-8337-e1a55cbf8c1d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:25.170906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 878/1749] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:25.172348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897c2e3-cd20-4733-842c-3bfeacdf44cc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:25.172644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897c2e3-cd20-4733-842c-3bfeacdf44cc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:25.172924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897c2e3-cd20-4733-842c-3bfeacdf44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:25.191690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:25.266751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d897c2e3-cd20-4733-842c-3bfeacdf44cc None None] MFA Rules not processed for user `0ffbfc994b03410faf1a124ac7d4cc72`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:25.268469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d897c2e3-cd20-4733-842c-3bfeacdf44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:25.310245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 879/1750] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:25.312091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897c2e3-cd20-4733-842c-3bfeacdf44cc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:25.371599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897c2e3-cd20-4733-842c-3bfeacdf44cc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:25.388665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:25.391780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:25.391881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 872/1751] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:25.393504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:25.393789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] PATH_INFO: `/v3/projects/ad926c2cf7744edbb5bb1c44d60a2014/users/b99b742ab2704f1997866fd50aefb4ed/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:25.401533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eb5cd-992d-49b9-80b8-9d7e8dbeeacd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:25.468759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad926c2cf7744edbb5bb1c44d60a2014, user_id=b99b742ab2704f1997866fd50aefb4ed, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:25.473760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:25.508039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 880/1752] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:25 2022] PUT /identity/v3/projects/ad926c2cf7744edbb5bb1c44d60a2014/users/b99b742ab2704f1997866fd50aefb4ed/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:25.510106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:25.602002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eb5cd-992d-49b9-80b8-9d7e8dbeeacd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:25.639849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cce7d1-77e0-4cc6-b27b-698b8160baa7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:25.645326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:25.646881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:25.647352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:25.647783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] PATH_INFO: `/v3/users/33c487345d51496fab899ea31371be6c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:25.649811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c487345d51496fab899ea31371be6c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:25.652279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:25.654422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:25.764042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:25.765728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:25.766447 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:25.767074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:25.769319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c487345d51496fab899ea31371be6c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:25.790498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c487345d51496fab899ea31371be6c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:25.823189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c487345d51496fab899ea31371be6c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:25.845255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c487345d51496fab899ea31371be6c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:25.846904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f31a6c04-87f3-4102-a863-94dde503feec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c487345d51496fab899ea31371be6c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:25.859965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 881/1753] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:25 2022] DELETE /identity/v3/users/33c487345d51496fab899ea31371be6c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:25.862736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342a37-aa9b-4083-98ac-292e6310793b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:25.863164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342a37-aa9b-4083-98ac-292e6310793b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:25.863630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6342a37-aa9b-4083-98ac-292e6310793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:25.907025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:25.911332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:25.916908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b6342a37-aa9b-4083-98ac-292e6310793b None None] MFA Rules not processed for user `58298868d67d4aa584a9fed53e4358a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:25.920813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b6342a37-aa9b-4083-98ac-292e6310793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:25.921495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:25.938452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 873/1754] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:25.939937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:25.966658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be507d97-74d5-401a-bfd2-21efe8c9297f service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:26.077785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 882/1755] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:26.081421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:26.082588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:26.084836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:26.121912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:26.123491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:26.124706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:26.125879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:26.140074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:26.147362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:26.148767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:26.151512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:26.171096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 874/1756] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:26.172008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 883/1757] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:26.177350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:26.180172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:26.184783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:26.185625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:26.220162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf87b4-fd4c-4f3d-9f4e-f956c9c9bf2e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:26.226411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e7c2e-6b16-42f6-9f1b-6be0ee69ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:26.227503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e7c2e-6b16-42f6-9f1b-6be0ee69ca62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:26.227920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e7c2e-6b16-42f6-9f1b-6be0ee69ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:26.228500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e7c2e-6b16-42f6-9f1b-6be0ee69ca62 admin admin] PATH_INFO: `/v3/projects/ad926c2cf7744edbb5bb1c44d60a2014/users/b99b742ab2704f1997866fd50aefb4ed/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:26.230881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e7c2e-6b16-42f6-9f1b-6be0ee69ca62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad926c2cf7744edbb5bb1c44d60a2014, user_id=b99b742ab2704f1997866fd50aefb4ed, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:26.234083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e7c2e-6b16-42f6-9f1b-6be0ee69ca62 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:26.246931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 875/1758] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:26 2022] PUT /identity/v3/projects/ad926c2cf7744edbb5bb1c44d60a2014/users/b99b742ab2704f1997866fd50aefb4ed/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:26.258706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:26.259103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:26.259473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:26.290988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] MFA Rules not processed for user `b99b742ab2704f1997866fd50aefb4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:26.292400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:26.355457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb441d-c512-43ae-b498-29a7cd2cd844 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:26.384913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:26.448334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 876/1759] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:26.449538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:26.451865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:26.517130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:26.517932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:26.518382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:26.518716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:26.530766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:26.557516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f12a9-2632-4081-9d3b-fdeb1ff0edc6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:26.562335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:26.563118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:26.563474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:26.563824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:26.607093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:26.721288 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:26.724189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:26.735438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:26.745524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:26.746208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 884/1760] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:26.759965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:26.762487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:26.767987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 877/1761] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:26.930561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb327e-9cdb-497b-8a24-713c51e923e5 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:26.946275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228c2bd-6cdd-43d0-8700-4d6476e7475e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:26.947187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228c2bd-6cdd-43d0-8700-4d6476e7475e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:26.947367 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228c2bd-6cdd-43d0-8700-4d6476e7475e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:26.947609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228c2bd-6cdd-43d0-8700-4d6476e7475e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:26.963130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228c2bd-6cdd-43d0-8700-4d6476e7475e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:26.969108 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228c2bd-6cdd-43d0-8700-4d6476e7475e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:26.999700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 885/1762] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:27.147139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:27.161350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1602-65c4-4a90-9e6b-f5b69333bfcd None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.161799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1602-65c4-4a90-9e6b-f5b69333bfcd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.162210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1602-65c4-4a90-9e6b-f5b69333bfcd None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.164661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 886/1763] 10.222.0.50 () {54 vars in 912 bytes} [Tue Jul 12 17:27:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:27.177779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.178362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.178542 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.192134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562336f8-09eb-4a96-9d67-a7e4796774a7 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:27.216418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:27.217588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.217813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.219473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] PATH_INFO: `/v3/users/05c1ca1d25b548d1b4a1c5b2e8e357fc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.224451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c1ca1d25b548d1b4a1c5b2e8e357fc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:27.226517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:27.325188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] MFA Rules not processed for user `164446c4b65e4043a492dc626a571e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:27.328591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:27.351200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 887/1764] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:27.374578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c1ca1d25b548d1b4a1c5b2e8e357fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:27.375265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c1ca1d25b548d1b4a1c5b2e8e357fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:27.375875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c1ca1d25b548d1b4a1c5b2e8e357fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:27.396619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c1ca1d25b548d1b4a1c5b2e8e357fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:27.424951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:27.426547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:27.442970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-edc4f203-57eb-4400-8a33-fd033dc4b55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c1ca1d25b548d1b4a1c5b2e8e357fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:27.453340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d08bb-9363-4480-9add-b2a574a09255 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:27.477417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:27.477633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.481391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.481706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.485520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 878/1765] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:27 2022] DELETE /identity/v3/users/05c1ca1d25b548d1b4a1c5b2e8e357fc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:27.490079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3108-8b18-4487-a5a6-e31454253edd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.490813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3108-8b18-4487-a5a6-e31454253edd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.490813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b3108-8b18-4487-a5a6-e31454253edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.491453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:27.527013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:27.529878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:27.547493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a55b3108-8b18-4487-a5a6-e31454253edd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:27.548794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a55b3108-8b18-4487-a5a6-e31454253edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:27.563064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 888/1766] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:27:27.723285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 879/1767] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:27.773457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:27.774993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:27.792462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924db314-ae9b-427f-a678-d4abdb8b992a service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:27.850944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:27.950448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:27.951163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.951457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.952343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.978657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9a7f-08ab-4756-ac70-d293c09a580b None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.979164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9a7f-08ab-4756-ac70-d293c09a580b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.979262 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9a7f-08ab-4756-ac70-d293c09a580b None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.980628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 880/1768] 10.222.0.50 () {54 vars in 912 bytes} [Tue Jul 12 17:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:27:27.990502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be5c3-15b7-45c2-88ca-43bdab4b0aa7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:27.990502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be5c3-15b7-45c2-88ca-43bdab4b0aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:27.990850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926be5c3-15b7-45c2-88ca-43bdab4b0aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:27.992356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:27.993864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:28.017663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 889/1769] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:28.027901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-926be5c3-15b7-45c2-88ca-43bdab4b0aa7 None None] MFA Rules not processed for user `164446c4b65e4043a492dc626a571e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:28.029792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-926be5c3-15b7-45c2-88ca-43bdab4b0aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:28.058848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 881/1770] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:27:28.075731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:28.099011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81644d1d-e0ca-4841-961e-7d08d382c107 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:28.121183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:28.122164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:28.122537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:28.122883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:28.144404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:28.144404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:28.164825 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 890/1771] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:28.801869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b2f1-d15b-41f1-8396-b1ec79347838 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:28.802434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b2f1-d15b-41f1-8396-b1ec79347838 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:28.802752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b2f1-d15b-41f1-8396-b1ec79347838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:28.833356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:28.840228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:28.880015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3182b2f1-d15b-41f1-8396-b1ec79347838 None None] MFA Rules not processed for user `190092274f6843959bf16a569a388ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:28.882488 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3182b2f1-d15b-41f1-8396-b1ec79347838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:28.889262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b59d1-fcd5-4d8e-886f-f706ca9315c2 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:28.903020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:28.932500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:28.949598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:28.949911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:28.950163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] PATH_INFO: `/v3/projects/ba0e074242c1493f8cf9e6996bba0c96` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:28.955544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0e074242c1493f8cf9e6996bba0c96)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:28.970449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:29.028466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 882/1772] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:29.115075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0e074242c1493f8cf9e6996bba0c96', 'request_id': 'req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.130373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0e074242c1493f8cf9e6996bba0c96', 'request_id': 'req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.147668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0e074242c1493f8cf9e6996bba0c96', 'request_id': 'req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.199336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] The token cache is being invalidate because project ba0e074242c1493f8cf9e6996bba0c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:29.199336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.200623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5a4f6e88-ec17-4cd7-b0ef-0e67985f596b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.205308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 891/1773] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:28 2022] DELETE /identity/v3/projects/ba0e074242c1493f8cf9e6996bba0c96 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:29.207188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182b2f1-d15b-41f1-8396-b1ec79347838 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:29.245445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182b2f1-d15b-41f1-8396-b1ec79347838 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:29.389862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6be11-df2b-4db6-89f1-2cfd3a2e31db None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:29.392492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6be11-df2b-4db6-89f1-2cfd3a2e31db None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:29.394509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6be11-df2b-4db6-89f1-2cfd3a2e31db None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:29.397051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 892/1774] 10.222.0.50 () {54 vars in 960 bytes} [Tue Jul 12 17:27:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:29.403597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234c23-f533-4312-ab63-548e54587fdd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:29.404043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234c23-f533-4312-ab63-548e54587fdd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:29.405289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234c23-f533-4312-ab63-548e54587fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:29.450688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c234c23-f533-4312-ab63-548e54587fdd None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:29.451967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c234c23-f533-4312-ab63-548e54587fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:29.515054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:29.517871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:29.518157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:29.518676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] PATH_INFO: `/v3/users/916c28f69d144e55bc23ccb2ed650f98` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:29.530106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916c28f69d144e55bc23ccb2ed650f98)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:29.537636 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:29.697919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916c28f69d144e55bc23ccb2ed650f98'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.698647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916c28f69d144e55bc23ccb2ed650f98'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.700600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916c28f69d144e55bc23ccb2ed650f98'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.725484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916c28f69d144e55bc23ccb2ed650f98'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.726514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 893/1775] 10.222.0.50 () {58 vars in 1057 bytes} [Tue Jul 12 17:27:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:29.739223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234c23-f533-4312-ab63-548e54587fdd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:29.764066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234c23-f533-4312-ab63-548e54587fdd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:29.788787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:29.789477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:29.789834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:29.790028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:29.800405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9971064a-2d96-4016-9eda-b0854d0c5738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916c28f69d144e55bc23ccb2ed650f98'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:29.805400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:29.840315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 883/1776] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:29 2022] DELETE /identity/v3/users/916c28f69d144e55bc23ccb2ed650f98 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:29.844875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:29.846671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:29.890092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 894/1777] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:30.047440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:30.047799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:30.048528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:30.115810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] MFA Rules not processed for user `7e5a33e74f604488b83efeec71ca7981`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:30.119778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:30.132634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:30.135303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:30.248447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ea4a3-995b-427b-80e5-9e2aa5afd6f6 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:30.309914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:30.338126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:30.366965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 884/1778] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:30.390733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:30.396171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:30.493410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:30.494175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:30.494481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:30.494762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] PATH_INFO: `/v3/projects/c7844f0e58004357958ede6b47998691` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:30.497401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7844f0e58004357958ede6b47998691)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:30.499400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:30.579310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5aa9-a928-4b7e-a46b-608fbea91063 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:30.589270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da3d27-98b0-471d-96c5-51d97bfe3e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:30.590498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3d27-98b0-471d-96c5-51d97bfe3e70 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:30.590782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3d27-98b0-471d-96c5-51d97bfe3e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:30.591226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da3d27-98b0-471d-96c5-51d97bfe3e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:30.602865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-73da3d27-98b0-471d-96c5-51d97bfe3e70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:30.676497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7844f0e58004357958ede6b47998691', 'request_id': 'req-3192d144-993d-4dcf-8907-2188c0b70525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:30.706422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7844f0e58004357958ede6b47998691', 'request_id': 'req-3192d144-993d-4dcf-8907-2188c0b70525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:30.742025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7844f0e58004357958ede6b47998691', 'request_id': 'req-3192d144-993d-4dcf-8907-2188c0b70525'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:30.779448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] The token cache is being invalidate because project c7844f0e58004357958ede6b47998691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:30.780989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:30.783376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:30.789810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 895/1779] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:30 2022] DELETE /identity/v3/projects/c7844f0e58004357958ede6b47998691 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:30.795268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:30.819508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:30.909683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3d27-98b0-471d-96c5-51d97bfe3e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:30.912424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da3d27-98b0-471d-96c5-51d97bfe3e70 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:30.951230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 885/1780] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:30.952952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:30.955935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:30.956449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:31.000075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192d144-993d-4dcf-8907-2188c0b70525 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:31.015753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:31.016639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:31.016926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:31.017221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] PATH_INFO: `/v3/users/b99b742ab2704f1997866fd50aefb4ed` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:31.022562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99b742ab2704f1997866fd50aefb4ed)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:31.024553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:31.052512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] MFA Rules not processed for user `58298868d67d4aa584a9fed53e4358a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:31.054535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:31.219822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99b742ab2704f1997866fd50aefb4ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:31.233348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:31.235224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 886/1781] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:31.265035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99b742ab2704f1997866fd50aefb4ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:31.304318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99b742ab2704f1997866fd50aefb4ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:31.324620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99b742ab2704f1997866fd50aefb4ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:31.327357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe9ce0e8-5c6f-4ede-9e9f-32b378baa393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99b742ab2704f1997866fd50aefb4ed'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:31.345283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 896/1782] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:30 2022] DELETE /identity/v3/users/b99b742ab2704f1997866fd50aefb4ed => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:31.976384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:31.979562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:32.037471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06eda70-73bd-4d83-be21-c0ba19bdfb5f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:32.240375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:32.264456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:32.267406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:32.270878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:32.271194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] PATH_INFO: `/v3/projects/f9339a9780334571b485d4f0812a3d72` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:32.272612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9339a9780334571b485d4f0812a3d72)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:32.280336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:32.411936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9339a9780334571b485d4f0812a3d72', 'request_id': 'req-48a6d0ec-8f9f-4e27-911d-396851629c1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:32.435223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9339a9780334571b485d4f0812a3d72', 'request_id': 'req-48a6d0ec-8f9f-4e27-911d-396851629c1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:32.447248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9339a9780334571b485d4f0812a3d72', 'request_id': 'req-48a6d0ec-8f9f-4e27-911d-396851629c1b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:32.480864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] The token cache is being invalidate because project f9339a9780334571b485d4f0812a3d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:32.483411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:32.485233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:32.498483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 887/1783] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:31 2022] DELETE /identity/v3/projects/f9339a9780334571b485d4f0812a3d72 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:32.498942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8d81-5392-4a59-9f9a-a81ec737bdcf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:32.499836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8d81-5392-4a59-9f9a-a81ec737bdcf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:32.500256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8d81-5392-4a59-9f9a-a81ec737bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:32.550841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-231c8d81-5392-4a59-9f9a-a81ec737bdcf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:32.554749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-231c8d81-5392-4a59-9f9a-a81ec737bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:32.836097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:32.837639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:32.900010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 897/1784] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:32.931622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e0a2-1c53-4448-af5e-3daa99cdff24 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:32.932950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e0a2-1c53-4448-af5e-3daa99cdff24 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:32.933244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e0a2-1c53-4448-af5e-3daa99cdff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:32.981736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-73b6e0a2-1c53-4448-af5e-3daa99cdff24 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:32.999617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-73b6e0a2-1c53-4448-af5e-3daa99cdff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:33.008030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6d0ec-8f9f-4e27-911d-396851629c1b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:33.014194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:33.015551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.015909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.016382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] PATH_INFO: `/v3/projects/ad926c2cf7744edbb5bb1c44d60a2014` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.017787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad926c2cf7744edbb5bb1c44d60a2014)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:33.020634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:33.026533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 898/1785] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:33.033687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e0a2-1c53-4448-af5e-3daa99cdff24 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:33.068138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e0a2-1c53-4448-af5e-3daa99cdff24 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:33.137225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad926c2cf7744edbb5bb1c44d60a2014', 'request_id': 'req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:33.145658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad926c2cf7744edbb5bb1c44d60a2014', 'request_id': 'req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:33.155612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad926c2cf7744edbb5bb1c44d60a2014', 'request_id': 'req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:33.186174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] The token cache is being invalidate because project ad926c2cf7744edbb5bb1c44d60a2014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:33.186468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:33.187560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a41f5a3d-7b4e-436c-98e7-49d2cc3cf3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:33.194252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 888/1786] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:32 2022] DELETE /identity/v3/projects/ad926c2cf7744edbb5bb1c44d60a2014 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:27:33.196363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcf156-4f17-4a68-a535-87824d781dcf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.196659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcf156-4f17-4a68-a535-87824d781dcf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.197727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fcf156-4f17-4a68-a535-87824d781dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.224610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:33.225974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.226355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.226491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c7fcf156-4f17-4a68-a535-87824d781dcf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:33.226800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.227604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:33.227993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:33.228100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7fcf156-4f17-4a68-a535-87824d781dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:33.231365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:33.240835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 889/1787] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:33.252857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2398-5a6a-4011-b743-23bec08b76b5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.253224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2398-5a6a-4011-b743-23bec08b76b5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.253729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc2398-5a6a-4011-b743-23bec08b76b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.269004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 899/1788] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:33.271699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:33.275857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:33.329328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:33.371954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-69cc2398-5a6a-4011-b743-23bec08b76b5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:33.374852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e349a-4179-43c6-a99f-1c466320dc49 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:33.378805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-69cc2398-5a6a-4011-b743-23bec08b76b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:33.412132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:33.418065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.420202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.422399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.429931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:33.430139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 890/1789] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:33.430877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2398-5a6a-4011-b743-23bec08b76b5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:33.440757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:33.466266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc2398-5a6a-4011-b743-23bec08b76b5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:33.487929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:33.489484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.489809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.490179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.491329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:33.492380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:33.494714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:33.515933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 891/1790] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:33.528461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:33.543789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ed8c-5340-4f5c-9451-2500560334c1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:33.557086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 900/1791] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:33 2022] POST /identity/v3/projects => generated 381 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:33.562814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:33.563842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.564241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.564564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.565473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:33.567454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:33.568878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:33.631497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 892/1792] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:33 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:33.632901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:33.664171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:33.748440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250369de-ae1a-447e-b9b6-43de0b9836a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:33.903387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e49dfb-8dfa-4280-97eb-6e23dc967103 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:33.921386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:33.922523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.923000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.923379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.924835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:33.927589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:33.936578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:33.939875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:33.940843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:33.941232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:33.947444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:33.957888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:33.976945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 901/1793] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:33 2022] POST /identity/v3/users => generated 291 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:33.979844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.002908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a465e-2f41-434e-9cb3-6e1321384292 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:34.015592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:34.017342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.018783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.019141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.021070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:34.025255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:34.037426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 893/1794] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:33 2022] POST /identity/v3/users => generated 291 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:34.045274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.057225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 902/1795] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:34.058570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.089813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398be6b9-f7d4-4dac-b892-6452e2a10d16 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:34.129177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:34.131283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.131917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.132396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.133447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:34.134720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc6ca1-ef96-476c-b1e7-1d8c7d623314 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:34.136746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:34.149982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:34.150492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.150821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.151045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.159683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:34.165455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:34.175465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 903/1796] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:34.176876 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.189129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965c5ed-707e-4935-891a-c8dd79872f70 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:34.200683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:34.202338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.202687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.203012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] PATH_INFO: `/v3/projects/3eb1045d541e48e78a73ec95b3ec7d83/users/f6584b66d96945e0ab741990466b67ba/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.241469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 894/1797] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:34.245183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.254616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb1045d541e48e78a73ec95b3ec7d83, user_id=f6584b66d96945e0ab741990466b67ba, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:34.260007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:34.283261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6c2e-ea28-422c-8c76-edf3198be427 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:34.315642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc1ff2-b83e-4dc5-bb2c-2c1a84a27535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:34.316087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1ff2-b83e-4dc5-bb2c-2c1a84a27535 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.316410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1ff2-b83e-4dc5-bb2c-2c1a84a27535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.316737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc1ff2-b83e-4dc5-bb2c-2c1a84a27535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.317500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc1ff2-b83e-4dc5-bb2c-2c1a84a27535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:34.321220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc1ff2-b83e-4dc5-bb2c-2c1a84a27535 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:34.356543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 895/1798] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:34.368424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 904/1799] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:34 2022] PUT /identity/v3/projects/3eb1045d541e48e78a73ec95b3ec7d83/users/f6584b66d96945e0ab741990466b67ba/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:34.386728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea592d8-62fd-4816-a5df-3488a834f32e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.387027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea592d8-62fd-4816-a5df-3488a834f32e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.387306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea592d8-62fd-4816-a5df-3488a834f32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.391774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.462926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2ea592d8-62fd-4816-a5df-3488a834f32e None None] MFA Rules not processed for user `f6584b66d96945e0ab741990466b67ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:34.467161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2ea592d8-62fd-4816-a5df-3488a834f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:34.595978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e5258-c2b1-4ded-9a2c-0d8d49e49b13 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:34.616246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53cac1-cb1d-4c33-96ef-36c598bdecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:34.618864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53cac1-cb1d-4c33-96ef-36c598bdecb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.624500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53cac1-cb1d-4c33-96ef-36c598bdecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.624500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53cac1-cb1d-4c33-96ef-36c598bdecb4 admin admin] PATH_INFO: `/v3/projects/0072f384a68741839db183f0358ca0ba/users/3527ead617ac42089328021b089916a3/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.685924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53cac1-cb1d-4c33-96ef-36c598bdecb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0072f384a68741839db183f0358ca0ba, user_id=3527ead617ac42089328021b089916a3, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:34.697218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53cac1-cb1d-4c33-96ef-36c598bdecb4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:34.720462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 896/1800] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:34.723354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea592d8-62fd-4816-a5df-3488a834f32e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.745717 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea592d8-62fd-4816-a5df-3488a834f32e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:34.769643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 905/1801] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:34 2022] PUT /identity/v3/projects/0072f384a68741839db183f0358ca0ba/users/3527ead617ac42089328021b089916a3/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:34.783606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602e85-40c3-4323-bb7c-37608f76567f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.784941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602e85-40c3-4323-bb7c-37608f76567f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.785232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602e85-40c3-4323-bb7c-37608f76567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.788112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:34.821044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:34.872282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-84602e85-40c3-4323-bb7c-37608f76567f None None] MFA Rules not processed for user `3527ead617ac42089328021b089916a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:34.873632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-84602e85-40c3-4323-bb7c-37608f76567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:34.880851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:34.881924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:34.882401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:34.882950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:34.883970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:34.888391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:34.954098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 897/1802] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:34 2022] POST /identity/v3/projects => generated 381 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:34.957852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:34.990236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 906/1803] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:34.991321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602e85-40c3-4323-bb7c-37608f76567f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:35.018604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602e85-40c3-4323-bb7c-37608f76567f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:35.103258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:35.103999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.104317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.104596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.105297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:35.107972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:35.136797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8d424-2930-42d3-98f9-6f7a388abfb4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:35.155326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:35.156198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.156473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.156905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.161576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:35.168009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 907/1804] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:34 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:35.168185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:35.169326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:35.236427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 898/1805] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:34 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:27:35.240679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:35.277135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb66d0-7ef1-462c-bf49-da4cae9557de admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:35.429249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c903-5b95-4a45-882e-8bd24ca1d105 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:35.452726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:35.453425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.453755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.454031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.454891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:35.457112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:35.476301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:35.478350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.478350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.478350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.484591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:35.490714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:35.504708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 908/1806] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:35 2022] POST /identity/v3/users => generated 298 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:35.515550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:35.519151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:35.539503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46294a8c-6751-46fe-b8c5-a5e79f317d8d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:35.547862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:35.549328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.549659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.549933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] PATH_INFO: `/v3/users/080fa2d193c34373955e4a9197288cae` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.552874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=080fa2d193c34373955e4a9197288cae)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:35.553645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:35.559461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:35.585889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 899/1807] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:27:35.596978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:35.647015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92ef69-a207-4399-a125-cda7d9f6d2d9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:35.656016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:35.656591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080fa2d193c34373955e4a9197288cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:35.657054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.657203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.657597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.658478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:35.661172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:35.672009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080fa2d193c34373955e4a9197288cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:35.679787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 900/1808] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:35.679787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:35.694321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080fa2d193c34373955e4a9197288cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:35.699420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783af184-632c-41d5-8e97-a5a81c7b63f2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:35.702689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080fa2d193c34373955e4a9197288cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:35.703975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080fa2d193c34373955e4a9197288cae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:35.709963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24968b61-a24c-4fe6-bc84-1c24c9fcb550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:35.711322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24968b61-a24c-4fe6-bc84-1c24c9fcb550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.711870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24968b61-a24c-4fe6-bc84-1c24c9fcb550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.712161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24968b61-a24c-4fe6-bc84-1c24c9fcb550 admin admin] PATH_INFO: `/v3/projects/b6ac295af289452d9a46a1a8395d8a24/users/7718ede50b884d5882367dd4efab83bf/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.719604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 909/1809] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:35 2022] DELETE /identity/v3/users/080fa2d193c34373955e4a9197288cae => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:35.722769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:35.725386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:35.742496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24968b61-a24c-4fe6-bc84-1c24c9fcb550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ac295af289452d9a46a1a8395d8a24, user_id=7718ede50b884d5882367dd4efab83bf, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:35.748322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24968b61-a24c-4fe6-bc84-1c24c9fcb550 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:35.765721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:35.780010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 901/1810] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:35 2022] PUT /identity/v3/projects/b6ac295af289452d9a46a1a8395d8a24/users/7718ede50b884d5882367dd4efab83bf/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:35.787578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:35.790113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:35.790899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:35.843125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:35.845187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:35.892283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8e992-3a45-4bfe-9b0e-51a597557dfe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:36.053948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 902/1811] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:36.059783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:36.063128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:36.076709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:36.077936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.078487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.081459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] PATH_INFO: `/v3/projects/413600d30b3346c8a2dbaab1835b89ac/users/62ec985b2b3342a6823afe05f8e38ebf/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.097136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70bea-7843-44a8-9317-9788e7509abc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:36.111362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1d74b-8d96-4c1e-8c76-65ef3ec8727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:36.113846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d74b-8d96-4c1e-8c76-65ef3ec8727b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.114365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d74b-8d96-4c1e-8c76-65ef3ec8727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.115296 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d74b-8d96-4c1e-8c76-65ef3ec8727b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.116808 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1d74b-8d96-4c1e-8c76-65ef3ec8727b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:36.119950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1d74b-8d96-4c1e-8c76-65ef3ec8727b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:36.123269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=413600d30b3346c8a2dbaab1835b89ac, user_id=62ec985b2b3342a6823afe05f8e38ebf, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:36.128107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:36.146840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 903/1812] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:36.161156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e2d4-d445-48f3-bd13-4cbfb9582866 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.162511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e2d4-d445-48f3-bd13-4cbfb9582866 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.164320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412e2d4-d445-48f3-bd13-4cbfb9582866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.170644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 910/1813] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:35 2022] PUT /identity/v3/projects/413600d30b3346c8a2dbaab1835b89ac/users/62ec985b2b3342a6823afe05f8e38ebf/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:36.176479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:36.181890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:36.221300 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:36.341618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d412e2d4-d445-48f3-bd13-4cbfb9582866 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:36.346694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d412e2d4-d445-48f3-bd13-4cbfb9582866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:36.394864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6572f-64f8-4c59-a03e-f50873126ddc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:36.399597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:36.400547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.401028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.401399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.493990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:36.498468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:36.524745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 911/1814] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:36.526823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:36.549164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e383-d7b1-4ce9-bb13-b3fb6d669f38 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:36.565624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9b324-8798-4934-adab-2cf0f542bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:36.566581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9b324-8798-4934-adab-2cf0f542bc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.566861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9b324-8798-4934-adab-2cf0f542bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.568135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9b324-8798-4934-adab-2cf0f542bc87 admin admin] PATH_INFO: `/v3/projects/b6ac295af289452d9a46a1a8395d8a24/users/7718ede50b884d5882367dd4efab83bf/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.571837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9b324-8798-4934-adab-2cf0f542bc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ac295af289452d9a46a1a8395d8a24, user_id=7718ede50b884d5882367dd4efab83bf, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:36.574554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9b324-8798-4934-adab-2cf0f542bc87 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:36.586728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 904/1815] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:27:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:36.587695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e2d4-d445-48f3-bd13-4cbfb9582866 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:36.611038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 912/1816] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:36 2022] PUT /identity/v3/projects/b6ac295af289452d9a46a1a8395d8a24/users/7718ede50b884d5882367dd4efab83bf/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:36.622116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.622432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.622712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.635734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412e2d4-d445-48f3-bd13-4cbfb9582866 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:36.699690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] MFA Rules not processed for user `7718ede50b884d5882367dd4efab83bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:36.702607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:36.818373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:36.819023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.819306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.819577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.820326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:36.821949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:36.824029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:36.851889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 905/1817] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:36.856126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:36.880403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3b7c3-515c-4d68-bd07-dae9802cc1f1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:36.888102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 913/1818] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:27:36.895654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:36.896786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:36.897067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:36.897341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] PATH_INFO: `/v3/projects/413600d30b3346c8a2dbaab1835b89ac/users/62ec985b2b3342a6823afe05f8e38ebf/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:36.900524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=413600d30b3346c8a2dbaab1835b89ac, user_id=62ec985b2b3342a6823afe05f8e38ebf, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:36.903936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:36.904486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:36.905484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:36.960820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 906/1819] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:36 2022] PUT /identity/v3/projects/413600d30b3346c8a2dbaab1835b89ac/users/62ec985b2b3342a6823afe05f8e38ebf/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:36.960820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:36.960820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:36.967435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:37.009710 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab83c9b-8edc-44e2-9fb8-9a9986c536a2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:37.201728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6b30c-0f05-4f3b-b46a-9ab776293a88 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:37.220443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c4b80-c3f9-4c27-9feb-02c0264cf0bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:37.221222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c4b80-c3f9-4c27-9feb-02c0264cf0bc service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:37.224394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c4b80-c3f9-4c27-9feb-02c0264cf0bc service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:37.225365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c4b80-c3f9-4c27-9feb-02c0264cf0bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:37.234810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b1dd-760e-4a8e-9160-f02ade3fe64f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:37.235511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b1dd-760e-4a8e-9160-f02ade3fe64f service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:37.235799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b1dd-760e-4a8e-9160-f02ade3fe64f service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:37.236226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b1dd-760e-4a8e-9160-f02ade3fe64f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:37.420249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c4b80-c3f9-4c27-9feb-02c0264cf0bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:37.423157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c4b80-c3f9-4c27-9feb-02c0264cf0bc service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:37.462715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 907/1820] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:27:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:27:37.464766 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:37.474164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:37.475070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:37.548914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b1dd-760e-4a8e-9160-f02ade3fe64f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:37.555795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858b1dd-760e-4a8e-9160-f02ade3fe64f service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:37.573950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] MFA Rules not processed for user `62ec985b2b3342a6823afe05f8e38ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:37.581687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:37.626580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 914/1821] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:37.636443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3856d9-5faa-4263-a7f0-4802e631cf0d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:37.636560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3856d9-5faa-4263-a7f0-4802e631cf0d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:37.636759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3856d9-5faa-4263-a7f0-4802e631cf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:37.724870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5d3856d9-5faa-4263-a7f0-4802e631cf0d None None] MFA Rules not processed for user `164446c4b65e4043a492dc626a571e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:37.733787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d3856d9-5faa-4263-a7f0-4802e631cf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:37.950927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:37.998913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 915/1822] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 12 17:27:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:38.000449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3856d9-5faa-4263-a7f0-4802e631cf0d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:38.011955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3856d9-5faa-4263-a7f0-4802e631cf0d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:38.016376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:38.017557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:38.017791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:38.017955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:38.020249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:38.100181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 908/1823] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 633 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:38.119097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:38.129833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:38.148626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:38.174982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:38.174982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:38.186732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 916/1824] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:38.201671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157dfae-32c3-42d0-a831-c87de9b4bf29 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:38.226454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:38.227258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:38.227548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:38.227832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:38.257176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:38.258804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:38.285822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 909/1825] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:38.483531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:38.499777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd7dca-ab1e-47c6-9285-c5a36380e5b3 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:38.510339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:38.520498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:38.521286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:38.524319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:38.587145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:38.588861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:38.616578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 917/1826] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:27:38.629233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:38.640949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5d930-f692-4e78-bf03-c8dd6834bef5 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:38.656441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:38.660422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:38.660776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:38.661000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:38.668919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:38.953426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:38.961047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:38.998729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 910/1827] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:27:40.182181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:40.183720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:40.355454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:40.357600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:40.395672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ce358-29a9-4633-9c2b-6ad3938a6fee service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:40.408861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef32b0-8183-4868-a631-d33620021055 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:40.420515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:40.424793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:40.428444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:40.429623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] PATH_INFO: `/v3/users/1ae18204db634c23bb59ba92cc0a4e8d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:40.434623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:40.436079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae18204db634c23bb59ba92cc0a4e8d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:40.439071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:40.441101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:40.443588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:40.446038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] PATH_INFO: `/v3/projects/e416f93d9b6846bda88607db83857ffb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:40.451877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e416f93d9b6846bda88607db83857ffb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:40.462893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:40.599544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae18204db634c23bb59ba92cc0a4e8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.602564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae18204db634c23bb59ba92cc0a4e8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.603987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae18204db634c23bb59ba92cc0a4e8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.613438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e416f93d9b6846bda88607db83857ffb', 'request_id': 'req-b8bfc4b3-096f-4749-a949-db96db0595a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.641684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e416f93d9b6846bda88607db83857ffb', 'request_id': 'req-b8bfc4b3-096f-4749-a949-db96db0595a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.643298 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae18204db634c23bb59ba92cc0a4e8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.657138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e416f93d9b6846bda88607db83857ffb', 'request_id': 'req-b8bfc4b3-096f-4749-a949-db96db0595a5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.677511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cfdf856-6744-4fd8-bfd9-d03ad91735ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae18204db634c23bb59ba92cc0a4e8d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.696243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] The token cache is being invalidate because project e416f93d9b6846bda88607db83857ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:40.696543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.699248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:40.703313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 918/1828] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:40 2022] DELETE /identity/v3/projects/e416f93d9b6846bda88607db83857ffb => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:27:40.709245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 911/1829] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:40 2022] DELETE /identity/v3/users/1ae18204db634c23bb59ba92cc0a4e8d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:27:40.713856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:40.714561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:40.714999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:40.716235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:40.719992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:40.778761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:40.780028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:40.949675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfc4b3-096f-4749-a949-db96db0595a5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:40.968832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:40.995144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:41.043591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 912/1830] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:41.113774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:41.116018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:41.117623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:41.117928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] PATH_INFO: `/v3/users/bea774e4f5314f85a6a25d17abf3eee4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:41.121008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea774e4f5314f85a6a25d17abf3eee4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:41.128578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:41.186195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:41.190668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:41.351707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea774e4f5314f85a6a25d17abf3eee4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:41.371799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92810d8-f2c9-4081-a564-f6aa23d9e6f9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:41.373680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea774e4f5314f85a6a25d17abf3eee4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:41.380711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:41.381545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:41.381949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:41.382520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:41.412122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:41.414513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:41.425714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea774e4f5314f85a6a25d17abf3eee4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:41.437738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 913/1831] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:27:41.443908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea774e4f5314f85a6a25d17abf3eee4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:41.444704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a78965d1-e1d8-4c61-b879-cd2f784318d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea774e4f5314f85a6a25d17abf3eee4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:41.457632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 919/1832] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:40 2022] DELETE /identity/v3/users/bea774e4f5314f85a6a25d17abf3eee4 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:42.391299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:42.393470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:42.431274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28559dec-2b39-4abc-998f-9bc8d36b43ae service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:42.616084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:42.617017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:42.617302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:42.617608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] PATH_INFO: `/v3/users/3527ead617ac42089328021b089916a3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:42.623639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3527ead617ac42089328021b089916a3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:42.625655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:42.772719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3527ead617ac42089328021b089916a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:42.777217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3527ead617ac42089328021b089916a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:42.778169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3527ead617ac42089328021b089916a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:42.803768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3527ead617ac42089328021b089916a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:42.878252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3527ead617ac42089328021b089916a3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:42.911664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 914/1833] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:42 2022] DELETE /identity/v3/users/3527ead617ac42089328021b089916a3 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:42.916702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:42.917273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:42.917504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:42.972917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:42.991136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:43.229925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 920/1834] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:43.340839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:43.342400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:43.367577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:43.571638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d502-9192-4ba1-8dcd-6a6476b1754d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:43.605838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:43.605838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:43.605838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:43.606254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:43.647671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:43.654835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:43.692701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 915/1835] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:45.066901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:45.068599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:45.097420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd76f6-b8b4-4136-9c67-bee1b6da372a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:45.120178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:45.124135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:45.124667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:45.125151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] PATH_INFO: `/v3/projects/a05e7366264c461caf5f2d67a74b5b8e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:45.131916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05e7366264c461caf5f2d67a74b5b8e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:45.134206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:45.205309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:45.225431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05e7366264c461caf5f2d67a74b5b8e', 'request_id': 'req-76223b37-7031-4124-b1c1-1cb4b64d50fc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.255826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05e7366264c461caf5f2d67a74b5b8e', 'request_id': 'req-76223b37-7031-4124-b1c1-1cb4b64d50fc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.273090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05e7366264c461caf5f2d67a74b5b8e', 'request_id': 'req-76223b37-7031-4124-b1c1-1cb4b64d50fc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.322815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] The token cache is being invalidate because project a05e7366264c461caf5f2d67a74b5b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:45.323110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.324809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.337856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 921/1836] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:45 2022] DELETE /identity/v3/projects/a05e7366264c461caf5f2d67a74b5b8e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:45.339485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:45.363224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3a425-2658-4ad5-b67a-0077c36e8607 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:45.529102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:45.530890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:45.633287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:45.634238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:45.643133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:45.643426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] PATH_INFO: `/v3/users/aabc9c3584484aaeaa802aaf14e3d392` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:45.647711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabc9c3584484aaeaa802aaf14e3d392)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:45.650654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:45.716672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223b37-7031-4124-b1c1-1cb4b64d50fc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:45.727156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:45.728427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:45.729104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:45.729550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] PATH_INFO: `/v3/projects/57aab6324b2148a6aee492005b820c4a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:45.733140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aab6324b2148a6aee492005b820c4a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:45.738995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:45.777759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabc9c3584484aaeaa802aaf14e3d392'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.781008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabc9c3584484aaeaa802aaf14e3d392'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.782271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabc9c3584484aaeaa802aaf14e3d392'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.798952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabc9c3584484aaeaa802aaf14e3d392'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.855683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabc9c3584484aaeaa802aaf14e3d392'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.876116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aab6324b2148a6aee492005b820c4a', 'request_id': 'req-995462dc-4234-40c8-a592-c1f7daa2bf85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.878022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 916/1837] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:45 2022] DELETE /identity/v3/users/aabc9c3584484aaeaa802aaf14e3d392 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:45.890576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aab6324b2148a6aee492005b820c4a', 'request_id': 'req-995462dc-4234-40c8-a592-c1f7daa2bf85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.899135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aab6324b2148a6aee492005b820c4a', 'request_id': 'req-995462dc-4234-40c8-a592-c1f7daa2bf85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.918043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] The token cache is being invalidate because project 57aab6324b2148a6aee492005b820c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:45.918386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.919065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-995462dc-4234-40c8-a592-c1f7daa2bf85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:45.921185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 922/1838] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:45 2022] DELETE /identity/v3/projects/57aab6324b2148a6aee492005b820c4a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:45.925564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:45.928188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:46.009998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:46.080555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dfad8-2b0c-4450-918c-2b29e30a2ecf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:46.097920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:46.099252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:46.099762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:46.100240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] PATH_INFO: `/v3/users/f7b0289e8b7f4957b157612276282e61` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:46.101996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b0289e8b7f4957b157612276282e61)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:46.105119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:46.277209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b0289e8b7f4957b157612276282e61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:46.280455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b0289e8b7f4957b157612276282e61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:46.282240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b0289e8b7f4957b157612276282e61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:46.303929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b0289e8b7f4957b157612276282e61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:46.346151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0364196a-54b8-4a92-b8c8-47f2ffc46606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b0289e8b7f4957b157612276282e61'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:46.375184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 917/1839] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:45 2022] DELETE /identity/v3/users/f7b0289e8b7f4957b157612276282e61 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:46.646395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c921-cd9b-496e-9340-28f93c09a878 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:46.646983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c921-cd9b-496e-9340-28f93c09a878 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:46.646983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459c921-cd9b-496e-9340-28f93c09a878 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:46.648448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 923/1840] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:46.768960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:46.769526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:46.769976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:46.842267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:46.844623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:47.058578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c921-cd9b-496e-9340-28f93c09a878 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:47.060373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c459c921-cd9b-496e-9340-28f93c09a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:47.119861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 918/1841] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:27:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:47.236564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:47.323878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459c921-cd9b-496e-9340-28f93c09a878 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:47.349425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:47.349425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:47.349425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:47.349425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] PATH_INFO: `/v3/projects/0072f384a68741839db183f0358ca0ba` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:47.359547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0072f384a68741839db183f0358ca0ba)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:47.368960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:47.536135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0072f384a68741839db183f0358ca0ba', 'request_id': 'req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:47.564604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0072f384a68741839db183f0358ca0ba', 'request_id': 'req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:47.578408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0072f384a68741839db183f0358ca0ba', 'request_id': 'req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:47.641906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:47.645610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:47.649960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] The token cache is being invalidate because project 0072f384a68741839db183f0358ca0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:47.650491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:47.652265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:47.659587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 924/1842] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:47 2022] DELETE /identity/v3/projects/0072f384a68741839db183f0358ca0ba => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:27:47.661928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:47.667414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:47.699898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b3275-e2fd-469c-b0dc-73a1456ccb5f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:47.822770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:47.914533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3f9bf-cb8d-46c7-b360-2a66bdf00612 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:47.934065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:47.935736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:47.937177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:47.937552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:47.937836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] PATH_INFO: `/v3/users/62ec985b2b3342a6823afe05f8e38ebf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:47.938594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:47.939299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:47.939299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:47.941805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ec985b2b3342a6823afe05f8e38ebf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:47.944207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:47.945811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:47.992940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:47.998475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:48.061305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 919/1843] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:48.062680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:48.072411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:48.119992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a5f1f-9251-4f08-8dfb-d274ab44b776 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:48.124528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ec985b2b3342a6823afe05f8e38ebf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.136851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:48.138349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:48.138743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:48.139016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] PATH_INFO: `/v3/users/f6584b66d96945e0ab741990466b67ba` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:48.143058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6584b66d96945e0ab741990466b67ba)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:48.144499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ec985b2b3342a6823afe05f8e38ebf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.155528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:48.164687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ec985b2b3342a6823afe05f8e38ebf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.177844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:48.181509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ec985b2b3342a6823afe05f8e38ebf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.187485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b918aff7-f52e-4a4d-95d9-10baa4407650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ec985b2b3342a6823afe05f8e38ebf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.212182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 925/1844] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:47 2022] DELETE /identity/v3/users/62ec985b2b3342a6823afe05f8e38ebf => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:48.301965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6584b66d96945e0ab741990466b67ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.304081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6584b66d96945e0ab741990466b67ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.304686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6584b66d96945e0ab741990466b67ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.322639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6584b66d96945e0ab741990466b67ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.339755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6584b66d96945e0ab741990466b67ba'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:48.367491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 920/1845] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:48 2022] DELETE /identity/v3/users/f6584b66d96945e0ab741990466b67ba => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:48.373172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f13f-0778-48a1-ba1d-ba06988fd64d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:48.373626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f13f-0778-48a1-ba1d-ba06988fd64d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:48.374130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f13f-0778-48a1-ba1d-ba06988fd64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:48.474440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-24d9f13f-0778-48a1-ba1d-ba06988fd64d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:48.477640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-24d9f13f-0778-48a1-ba1d-ba06988fd64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:48.604493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 926/1846] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:48.663334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:48.664902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:48.806938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582154a-48ad-41e8-89a6-9fed9f2a4208 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:48.813140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87299a2b-d0cc-415c-9023-bff28562e99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:48.814485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87299a2b-d0cc-415c-9023-bff28562e99e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:48.815650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87299a2b-d0cc-415c-9023-bff28562e99e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:48.818157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87299a2b-d0cc-415c-9023-bff28562e99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:48.832174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253d2d9-eee5-4b8a-871f-baa980c5599c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:48.832770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253d2d9-eee5-4b8a-871f-baa980c5599c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:48.832770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253d2d9-eee5-4b8a-871f-baa980c5599c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:48.834142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 927/1847] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:48.838763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87299a2b-d0cc-415c-9023-bff28562e99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:48.838763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87299a2b-d0cc-415c-9023-bff28562e99e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:48.855728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 921/1848] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:48.937347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253d2d9-eee5-4b8a-871f-baa980c5599c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:48.947282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4253d2d9-eee5-4b8a-871f-baa980c5599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:48.976501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88a31-f545-4444-bf72-7866b5383fc4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:48.976792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88a31-f545-4444-bf72-7866b5383fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:48.977123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88a31-f545-4444-bf72-7866b5383fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:48.980772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253d2d9-eee5-4b8a-871f-baa980c5599c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:48.988237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:48.989525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:48.990719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:48.991207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] PATH_INFO: `/v3/projects/69b7ad095a8d40c28b033eb06cd6ee3e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:48.993066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b7ad095a8d40c28b033eb06cd6ee3e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:48.996020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:49.014948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-33e88a31-f545-4444-bf72-7866b5383fc4 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:49.016373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-33e88a31-f545-4444-bf72-7866b5383fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:49.135332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b7ad095a8d40c28b033eb06cd6ee3e', 'request_id': 'req-04eecaba-f7af-43a0-a85a-b8131c519b43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:49.147813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b7ad095a8d40c28b033eb06cd6ee3e', 'request_id': 'req-04eecaba-f7af-43a0-a85a-b8131c519b43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:49.158874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:49.159832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b7ad095a8d40c28b033eb06cd6ee3e', 'request_id': 'req-04eecaba-f7af-43a0-a85a-b8131c519b43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:49.205301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] The token cache is being invalidate because project 69b7ad095a8d40c28b033eb06cd6ee3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:49.205629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:49.208873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-04eecaba-f7af-43a0-a85a-b8131c519b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:49.216153 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 928/1849] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:48 2022] DELETE /identity/v3/projects/69b7ad095a8d40c28b033eb06cd6ee3e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:49.220567 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571908-bd03-4c7f-a01d-852e779b29f1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:49.220859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571908-bd03-4c7f-a01d-852e779b29f1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:49.221135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba571908-bd03-4c7f-a01d-852e779b29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:49.253123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 922/1850] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:27:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:27:49.256583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ba571908-bd03-4c7f-a01d-852e779b29f1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:49.258613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ba571908-bd03-4c7f-a01d-852e779b29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:49.418021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 929/1851] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:49.427612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8250-546f-400d-9814-3ffdbb52535f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:49.427941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8250-546f-400d-9814-3ffdbb52535f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:49.428167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc8250-546f-400d-9814-3ffdbb52535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:49.516682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-79fc8250-546f-400d-9814-3ffdbb52535f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:49.525780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79fc8250-546f-400d-9814-3ffdbb52535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:49.548293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 923/1852] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:49.553379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571908-bd03-4c7f-a01d-852e779b29f1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:49.594377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba571908-bd03-4c7f-a01d-852e779b29f1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:49.613753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:49.614610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:49.614894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:49.619690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:49.620612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:49.621021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:49.622778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:49.686388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 930/1853] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:49.688621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8250-546f-400d-9814-3ffdbb52535f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:49.701553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc8250-546f-400d-9814-3ffdbb52535f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:49.716190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:49.716905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:49.717198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:49.717482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:49.718204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:49.727497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:49.803209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 924/1854] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:49 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:49.807043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:49.846379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8d728-2382-468e-99dd-54c27baa4dd4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:49.877503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:49.998019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:50.000666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:50.127290 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:50.128056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:50.128506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:50.128780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:50.129607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:50.131699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:50.208996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 931/1855] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:49 2022] POST /identity/v3/users => generated 290 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:50.212899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:50.260922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a1cd9-f639-40f3-824f-f9e5e38251fc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:50.275980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd512922-9c18-4693-b1f5-bf329a41d478 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:50.287081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:50.288843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:50.292127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:50.293632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:50.296013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:50.297694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:50.300196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:50.300528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:50.300649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:50.300813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] PATH_INFO: `/v3/projects/441133929d824c0ba86e7e4cc2aec136` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:50.305419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] RBAC: Authorizing `identity:delete_project(project_id=441133929d824c0ba86e7e4cc2aec136)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:50.307477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:50.334055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 932/1856] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:50.336708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:50.365811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a24228-dab9-459b-9879-07c4d2942fc6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:50.389180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:50.396623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:50.399727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:50.400163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:50.402116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:50.406157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:50.433002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 933/1857] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:50.434132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441133929d824c0ba86e7e4cc2aec136', 'request_id': 'req-4e9950fa-4363-45c6-850b-737fe226209d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:50.434401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:50.442948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441133929d824c0ba86e7e4cc2aec136', 'request_id': 'req-4e9950fa-4363-45c6-850b-737fe226209d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:50.461360 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441133929d824c0ba86e7e4cc2aec136', 'request_id': 'req-4e9950fa-4363-45c6-850b-737fe226209d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:50.492285 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88e58b-39f0-45ae-b6a1-594f05606d52 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:50.508864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] The token cache is being invalidate because project 441133929d824c0ba86e7e4cc2aec136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:50.510943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:50.512627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-4e9950fa-4363-45c6-850b-737fe226209d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:50.517254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 925/1858] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:49 2022] DELETE /identity/v3/projects/441133929d824c0ba86e7e4cc2aec136 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:27:50.525450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:50.525742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:50.526017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:50.589602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:50.591240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:50.667816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:50.681816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f3ecf-a8be-4185-9fc2-dbe977f783fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:50.683227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3ecf-a8be-4185-9fc2-dbe977f783fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:50.683227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3ecf-a8be-4185-9fc2-dbe977f783fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:50.683462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f3ecf-a8be-4185-9fc2-dbe977f783fb admin admin] PATH_INFO: `/v3/projects/cb46f3d12b934a7ab65cce100d708d57/users/004de6c2af5549249702ce385cfa3955/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:50.745228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f3ecf-a8be-4185-9fc2-dbe977f783fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb46f3d12b934a7ab65cce100d708d57, user_id=004de6c2af5549249702ce385cfa3955, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:50.754505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f3ecf-a8be-4185-9fc2-dbe977f783fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:50.755813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 926/1859] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:50.756738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:50.760010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:50.784095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 934/1860] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:50 2022] PUT /identity/v3/projects/cb46f3d12b934a7ab65cce100d708d57/users/004de6c2af5549249702ce385cfa3955/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:50.789475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c98d-991b-4792-962b-63c522c373da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:50.792073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c98d-991b-4792-962b-63c522c373da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:50.793109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c98d-991b-4792-962b-63c522c373da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:50.832247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f525c98d-991b-4792-962b-63c522c373da None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:50.834121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f525c98d-991b-4792-962b-63c522c373da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:50.968686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:50.971433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59e83d-6909-4d39-9b11-3874dd32166d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.013937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 935/1861] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:51.015723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2df7da-f3c0-42ad-b854-e858efb2cb90 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.016181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2df7da-f3c0-42ad-b854-e858efb2cb90 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.016601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2df7da-f3c0-42ad-b854-e858efb2cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.051518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-df2df7da-f3c0-42ad-b854-e858efb2cb90 None None] MFA Rules not processed for user `004de6c2af5549249702ce385cfa3955`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:51.053011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-df2df7da-f3c0-42ad-b854-e858efb2cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.081199 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.082054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.082471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.083811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.085768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.100322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.102657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.116297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 927/1862] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:51.118139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.120845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.141857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c2e8f-6a21-4ead-b148-062e856c1b4b service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.151148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.152597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.153332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.153706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] PATH_INFO: `/v3/projects/413600d30b3346c8a2dbaab1835b89ac` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.161922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=413600d30b3346c8a2dbaab1835b89ac)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.166045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.193904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 936/1863] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:51.196944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2df7da-f3c0-42ad-b854-e858efb2cb90 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.225471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2df7da-f3c0-42ad-b854-e858efb2cb90 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.236510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.237554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.237958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.238348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.239179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:51.239944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.241666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.263872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 937/1864] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:51.264716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.273913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.285187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413600d30b3346c8a2dbaab1835b89ac', 'request_id': 'req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.289608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:51.293718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413600d30b3346c8a2dbaab1835b89ac', 'request_id': 'req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.299532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38135-e359-46ab-9f89-c689b9efee68 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.302654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413600d30b3346c8a2dbaab1835b89ac', 'request_id': 'req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.319777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] The token cache is being invalidate because project 413600d30b3346c8a2dbaab1835b89ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:51.320121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.320800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.323126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 928/1865] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:51 2022] DELETE /identity/v3/projects/413600d30b3346c8a2dbaab1835b89ac => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:51.330321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.331825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.369642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.370330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.370629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.370905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.371600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.373510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.401700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 938/1866] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:51 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:51.402505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.405571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.412680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43081d0-a62f-4ed0-8d8f-5d45a7eeac11 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.468955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.469845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.470168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.470483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] PATH_INFO: `/v3/projects/3eb1045d541e48e78a73ec95b3ec7d83` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.472765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb1045d541e48e78a73ec95b3ec7d83)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.478196 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6440cce-1c80-4d18-9254-928c64d93b13 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.480062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.491267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd14ef-d973-4797-bd00-3bcb62ae572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.492466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd14ef-d973-4797-bd00-3bcb62ae572d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.493172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd14ef-d973-4797-bd00-3bcb62ae572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.493774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd14ef-d973-4797-bd00-3bcb62ae572d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.494798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd14ef-d973-4797-bd00-3bcb62ae572d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.497120 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd14ef-d973-4797-bd00-3bcb62ae572d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.502162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:51.544049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 939/1867] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:51 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:51.546357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb1045d541e48e78a73ec95b3ec7d83', 'request_id': 'req-c7925e69-57d3-4046-9e6d-6a715e48852a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.546491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.547159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.547535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.554365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb1045d541e48e78a73ec95b3ec7d83', 'request_id': 'req-c7925e69-57d3-4046-9e6d-6a715e48852a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.564519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb1045d541e48e78a73ec95b3ec7d83', 'request_id': 'req-c7925e69-57d3-4046-9e6d-6a715e48852a'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.576819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:51.578479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.583336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] The token cache is being invalidate because project 3eb1045d541e48e78a73ec95b3ec7d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:51.584387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.586142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.592027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 929/1868] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:51 2022] DELETE /identity/v3/projects/3eb1045d541e48e78a73ec95b3ec7d83 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:51.594513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.596658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.639486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:51.676678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 940/1869] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:51.678553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.680208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.696248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3131e3-7d95-452f-ba84-bb7bab4fad50 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.701546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.702409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.702799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.703441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.704086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.706590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7925e69-57d3-4046-9e6d-6a715e48852a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.707593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.712148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d9119-8768-4160-af6a-d928f6787ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.713201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9119-8768-4160-af6a-d928f6787ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.713633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9119-8768-4160-af6a-d928f6787ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.714090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d9119-8768-4160-af6a-d928f6787ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.715368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d9119-8768-4160-af6a-d928f6787ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.718592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d9119-8768-4160-af6a-d928f6787ec4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.738725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 941/1870] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:51 2022] POST /identity/v3/users => generated 293 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:51.739872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.742466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.758625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 930/1871] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:51 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:51.758625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb58c8-9990-4bc1-8894-7e61268807da None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.758625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb58c8-9990-4bc1-8894-7e61268807da None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.758625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb58c8-9990-4bc1-8894-7e61268807da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.762175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fcedb-41d4-456a-8042-896fc63fe71c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.768317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.769396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.775706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.776326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] PATH_INFO: `/v3/users/7718ede50b884d5882367dd4efab83bf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.778194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7718ede50b884d5882367dd4efab83bf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.780580 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.791897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c8fb58c8-9990-4bc1-8894-7e61268807da None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:51.793673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c8fb58c8-9990-4bc1-8894-7e61268807da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.805375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 931/1872] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:51.806475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb58c8-9990-4bc1-8894-7e61268807da None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.820570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb58c8-9990-4bc1-8894-7e61268807da None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.826401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.827199 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.827821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.827821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.828397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.830091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.842785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 932/1873] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:51.842785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.854866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4f7b8-1727-4ba4-bfa4-3c5421e3cacf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.860570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.861599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.862188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.862810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.864743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.865890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.879275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 933/1874] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:51.882089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7718ede50b884d5882367dd4efab83bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.883396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.892129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7718ede50b884d5882367dd4efab83bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.896515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b580a-3f66-462b-bf7a-a2d7b7b740e7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.902040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:51.902903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:51.903342 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:51.903717 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:51.904559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:51.904939 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:51.906597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:51.908935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7718ede50b884d5882367dd4efab83bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.916671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7718ede50b884d5882367dd4efab83bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.917414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7718ede50b884d5882367dd4efab83bf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:51.923598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 934/1875] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:51.923598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.923598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.927847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 942/1876] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:51 2022] DELETE /identity/v3/users/7718ede50b884d5882367dd4efab83bf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:51.928721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:51.933400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:51.939835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47babb40-2b8b-41de-a9ae-73af00cc3982 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:51.988666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:52.011787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.012556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.012905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.013183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.013924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.015754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.023835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57c0ec-bcae-45a9-aee6-c863c4575cc3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.029511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 935/1877] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:52.030644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.032233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.033582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.033823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.034103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.034467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.035260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.036922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.047767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 943/1878] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:52.048399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7852d96-e8da-40de-a801-31f231ce30aa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.049233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.058676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.059355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.059634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.059925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.060063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db420629-4360-4534-bba4-4ea8aa47ee11 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.060600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.062730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.065031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.065929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.066217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.066524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] PATH_INFO: `/v3/projects/d3835bd101f14fe6832cc998d46a42c8/users/f2722f6db08d4ba0b50f28d2ff1192f0/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.088810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3835bd101f14fe6832cc998d46a42c8, user_id=f2722f6db08d4ba0b50f28d2ff1192f0, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.091804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.103161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 936/1879] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:52.104261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.112402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 944/1880] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:52 2022] PUT /identity/v3/projects/d3835bd101f14fe6832cc998d46a42c8/users/f2722f6db08d4ba0b50f28d2ff1192f0/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:52.113120 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.168805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:52.191466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1bcd8-0198-41cf-bd8e-e3e87e1a0c60 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.192651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af886305-a916-4068-8a00-5e065d7a3416 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.196946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.197702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9012c1b-447f-40bd-8619-14cc968eed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.197824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.198097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.198418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9012c1b-447f-40bd-8619-14cc968eed25 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.198513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] PATH_INFO: `/v3/projects/490cc645f9a14bb08bf868177fe7ac0a/users/d94fb2f012184c098c7689ee7ae28c13/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.198705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9012c1b-447f-40bd-8619-14cc968eed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.198987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9012c1b-447f-40bd-8619-14cc968eed25 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.199809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9012c1b-447f-40bd-8619-14cc968eed25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.201978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9012c1b-447f-40bd-8619-14cc968eed25 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.215307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=490cc645f9a14bb08bf868177fe7ac0a, user_id=d94fb2f012184c098c7689ee7ae28c13, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.218005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.229974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 945/1881] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/users => generated 295 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:52.229974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f223ed-849a-457a-8265-9047b201aabb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.229974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f223ed-849a-457a-8265-9047b201aabb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.229974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f223ed-849a-457a-8265-9047b201aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.239701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 937/1882] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:52 2022] PUT /identity/v3/projects/490cc645f9a14bb08bf868177fe7ac0a/users/d94fb2f012184c098c7689ee7ae28c13/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:52.239701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.261012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-08f223ed-849a-457a-8265-9047b201aabb None None] MFA Rules not processed for user `f2722f6db08d4ba0b50f28d2ff1192f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:52.262436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08f223ed-849a-457a-8265-9047b201aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.326723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd236631-8f21-4f50-841d-a746644bf633 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.331610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744920e5-266b-4b80-8371-c427895eed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.332369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744920e5-266b-4b80-8371-c427895eed49 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.332717 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744920e5-266b-4b80-8371-c427895eed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.333697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744920e5-266b-4b80-8371-c427895eed49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.334541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744920e5-266b-4b80-8371-c427895eed49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.336302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744920e5-266b-4b80-8371-c427895eed49 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.346647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 938/1883] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:52.348046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9a26-13a7-4ae6-b4a9-27569c310470 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.348408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9a26-13a7-4ae6-b4a9-27569c310470 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.348755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9a26-13a7-4ae6-b4a9-27569c310470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.356200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 946/1884] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:52.357611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f223ed-849a-457a-8265-9047b201aabb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.359071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-08f223ed-849a-457a-8265-9047b201aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.378427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f223ed-849a-457a-8265-9047b201aabb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.380469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-06ea9a26-13a7-4ae6-b4a9-27569c310470 None None] MFA Rules not processed for user `d94fb2f012184c098c7689ee7ae28c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:52.381793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-06ea9a26-13a7-4ae6-b4a9-27569c310470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.383210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.384172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.384524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.384856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] PATH_INFO: `/v3/projects/b6ac295af289452d9a46a1a8395d8a24` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.386102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ac295af289452d9a46a1a8395d8a24)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.388101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.422694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:52.445311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ac295af289452d9a46a1a8395d8a24', 'request_id': 'req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:52.456452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ac295af289452d9a46a1a8395d8a24', 'request_id': 'req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:52.462949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ac295af289452d9a46a1a8395d8a24', 'request_id': 'req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:52.474732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 939/1885] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:52.474732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea9a26-13a7-4ae6-b4a9-27569c310470 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.480311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] The token cache is being invalidate because project b6ac295af289452d9a46a1a8395d8a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:52.481383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:52.482727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:52.488004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 947/1886] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:52 2022] DELETE /identity/v3/projects/b6ac295af289452d9a46a1a8395d8a24 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:52.488004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.488224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea9a26-13a7-4ae6-b4a9-27569c310470 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.488342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.539005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:52.551750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.552434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.552716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.553117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.553859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.555545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.560860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5a034-7953-4c64-a7fd-ccec2c0f6c69 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.566027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3cecc-95c9-4576-b1e0-ad67bcd27c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.567067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cecc-95c9-4576-b1e0-ad67bcd27c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.567067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cecc-95c9-4576-b1e0-ad67bcd27c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.567267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cecc-95c9-4576-b1e0-ad67bcd27c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.567965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3cecc-95c9-4576-b1e0-ad67bcd27c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.568227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 940/1887] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:52.569321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.569937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3cecc-95c9-4576-b1e0-ad67bcd27c8b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.572543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.592693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753992-33e4-4143-af8b-e127479823ce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.597603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.598299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.598587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.598854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.599542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.601452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.612300 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 948/1888] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:52.613549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b982-2730-4949-8d48-7c0cf470197e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.613911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b982-2730-4949-8d48-7c0cf470197e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.614191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632b982-2730-4949-8d48-7c0cf470197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.632135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 941/1889] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:52.633035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.634629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.635032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7632b982-2730-4949-8d48-7c0cf470197e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:52.636536 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7632b982-2730-4949-8d48-7c0cf470197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.694811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 949/1890] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:52.695640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632b982-2730-4949-8d48-7c0cf470197e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.705965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9866d64-d3a2-4749-aafb-ac59bfdb11ce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.706172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632b982-2730-4949-8d48-7c0cf470197e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.712394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45613a1a-4aee-4382-be4d-4c5bfb814f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.713341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613a1a-4aee-4382-be4d-4c5bfb814f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.713801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613a1a-4aee-4382-be4d-4c5bfb814f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.714083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45613a1a-4aee-4382-be4d-4c5bfb814f43 admin admin] PATH_INFO: `/v3/projects/0c0f512617f04849bef57850dd39ae7a/users/afa54727cd47498d8a0642dfd9abfc73/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.715620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.716310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.717180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.717180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.717809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.721528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.731545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45613a1a-4aee-4382-be4d-4c5bfb814f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0f512617f04849bef57850dd39ae7a, user_id=afa54727cd47498d8a0642dfd9abfc73, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.734731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45613a1a-4aee-4382-be4d-4c5bfb814f43 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.750192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 950/1891] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/users => generated 300 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:52.750192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.753213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 942/1892] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:52 2022] PUT /identity/v3/projects/0c0f512617f04849bef57850dd39ae7a/users/afa54727cd47498d8a0642dfd9abfc73/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:52.754658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362137-cbc4-4bfe-83cc-f333b4d7a727 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.755045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362137-cbc4-4bfe-83cc-f333b4d7a727 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.755490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362137-cbc4-4bfe-83cc-f333b4d7a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.760873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72645-9944-4125-ba28-eea725f0770e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.778903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a8362137-cbc4-4bfe-83cc-f333b4d7a727 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:52.780695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:52.781002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a8362137-cbc4-4bfe-83cc-f333b4d7a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.836912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29589a2a-89fe-4835-9f43-ceeae34fe287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.837727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29589a2a-89fe-4835-9f43-ceeae34fe287 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.838120 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29589a2a-89fe-4835-9f43-ceeae34fe287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.838495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29589a2a-89fe-4835-9f43-ceeae34fe287 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.839259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29589a2a-89fe-4835-9f43-ceeae34fe287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.841268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29589a2a-89fe-4835-9f43-ceeae34fe287 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.858428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 943/1893] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:52.860406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8362137-cbc4-4bfe-83cc-f333b4d7a727 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.868445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 951/1894] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:52.868445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accf23-dd2c-439a-b596-bf1ec6297a1b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.868445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accf23-dd2c-439a-b596-bf1ec6297a1b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.868445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56accf23-dd2c-439a-b596-bf1ec6297a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.871931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8362137-cbc4-4bfe-83cc-f333b4d7a727 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.877510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.878202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.878639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.878916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.879840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.883973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.902249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 944/1895] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:52.902924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-56accf23-dd2c-439a-b596-bf1ec6297a1b None None] MFA Rules not processed for user `afa54727cd47498d8a0642dfd9abfc73`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:52.903200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.904592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-56accf23-dd2c-439a-b596-bf1ec6297a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:52.914093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec39a-317e-4b60-bedf-c311f30c9abe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.921462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.923074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.923626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.923951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.924698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:52.925005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.929668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.947978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 945/1896] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:52.947978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.958894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c2c95-bffc-4504-962a-374ccf5e7e22 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.964889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:52.965583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:52.965864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:52.966134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:52.967237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:52.969650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:52.981793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 946/1897] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:52.983034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:52.993609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83005a-a5a9-45ee-8e12-52f8d1e4acca admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:52.994555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 952/1898] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:52.995228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56accf23-dd2c-439a-b596-bf1ec6297a1b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.002153 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.003094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.003372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.003640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] PATH_INFO: `/v3/projects/ddd92baabe754752a2f71a98cc602b6f/users/ab2856e6885341bba9895aeaed424457/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.011568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56accf23-dd2c-439a-b596-bf1ec6297a1b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.017351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:53.017857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.018666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.019017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.019382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.020144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.022106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.024284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd92baabe754752a2f71a98cc602b6f, user_id=ab2856e6885341bba9895aeaed424457, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.027267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.050204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 947/1899] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:52 2022] PUT /identity/v3/projects/ddd92baabe754752a2f71a98cc602b6f/users/ab2856e6885341bba9895aeaed424457/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:53.051219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.051910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 953/1900] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:52 2022] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:53.052796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.135643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675587e-1703-43f7-8c15-42f49792ffcf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.137007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e583b0b-8922-491f-bce8-495862db3701 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.140764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.141452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.141732 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.142144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.142874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.143589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.144511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.144793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.144902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.145068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] PATH_INFO: `/v3/projects/8dd0a84db60241b9a3c716f3ad7de6f7/users/03c4469dad944941823b6d78b9c9dfc9/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.164032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd0a84db60241b9a3c716f3ad7de6f7, user_id=03c4469dad944941823b6d78b9c9dfc9, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.166950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.177754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 954/1901] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:53 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:53.177754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.182125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:53.187506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 948/1902] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:53 2022] PUT /identity/v3/projects/8dd0a84db60241b9a3c716f3ad7de6f7/users/03c4469dad944941823b6d78b9c9dfc9/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:53.189136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.259859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae1be1-aa0e-4da6-8be0-cc6f40f89746 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.260101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f21a49-3984-4692-af4a-8439bd45ff88 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.264614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.264948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.265296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.265579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.265837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.265933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.266234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.266597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.266693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.267444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.268451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.269541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.278828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 955/1903] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:53.279693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.291142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bc0cc-9eb0-4df1-a492-c1632be916ce admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.294540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 949/1904] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:53 2022] POST /identity/v3/users => generated 279 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:53.295438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.299049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.299792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.300149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.300428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.301117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.303255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.305015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da739592-1b98-4242-8f3f-0cbb5332e1a0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.309546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.310202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.310616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.310901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.311626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.313209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.323826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 956/1905] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:53 2022] POST /identity/v3/users => generated 300 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:53.324284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 950/1906] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:53.324657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.325773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.335269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6793f1f-05fe-4bae-a256-35ee053bbed2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.335916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a861-a9f6-4c79-904b-6f245496808f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.339778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.340666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.340945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.341043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.341298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] PATH_INFO: `/v3/projects/ddd92baabe754752a2f71a98cc602b6f/users/ab2856e6885341bba9895aeaed424457/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.341661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.341946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.342215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.342968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.343352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd92baabe754752a2f71a98cc602b6f, user_id=ab2856e6885341bba9895aeaed424457, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.344563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.346048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.355938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 951/1907] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:53.356760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.358034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 957/1908] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:53 2022] PUT /identity/v3/projects/ddd92baabe754752a2f71a98cc602b6f/users/ab2856e6885341bba9895aeaed424457/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:53.358865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.367779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162a21f-8e0c-40e8-8c6c-bd4e13e1dcfa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.410197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:53.426829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73358-e565-459d-8ae6-135e9b3640f6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.429803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.430526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.430806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.431077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.431427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa658f4-cbf8-47e2-b521-c569699dc5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.431824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.432339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa658f4-cbf8-47e2-b521-c569699dc5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.432619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa658f4-cbf8-47e2-b521-c569699dc5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.432893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa658f4-cbf8-47e2-b521-c569699dc5a3 admin admin] PATH_INFO: `/v3/projects/8dd0a84db60241b9a3c716f3ad7de6f7/users/03c4469dad944941823b6d78b9c9dfc9/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.433424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.435006 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa658f4-cbf8-47e2-b521-c569699dc5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd0a84db60241b9a3c716f3ad7de6f7, user_id=03c4469dad944941823b6d78b9c9dfc9, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.437673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa658f4-cbf8-47e2-b521-c569699dc5a3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.443771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 952/1909] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:53.444769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.448252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 958/1910] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:53 2022] PUT /identity/v3/projects/8dd0a84db60241b9a3c716f3ad7de6f7/users/03c4469dad944941823b6d78b9c9dfc9/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:53.449508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210a19-0dce-420d-9eab-63eb84e66ac5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.449797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210a19-0dce-420d-9eab-63eb84e66ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.450074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210a19-0dce-420d-9eab-63eb84e66ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.460469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8d06f-ad90-4834-b7fb-75ea16b60104 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.478189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-36210a19-0dce-420d-9eab-63eb84e66ac5 None None] MFA Rules not processed for user `ab2856e6885341bba9895aeaed424457`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:53.479501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36210a19-0dce-420d-9eab-63eb84e66ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:53.525831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.526760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.527796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.528227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.528971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.531160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.532945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:53.543868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 953/1911] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:53.544275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.556263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f88653-a1e3-49eb-a4e2-d2fa227e9c3d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.559240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 959/1912] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:53.560638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.560931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.561211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.565267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.566236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.566620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.566960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] PATH_INFO: `/v3/projects/9fdce196d08d427ba094729a3d933732/users/a5e60c150c934f67813701a4844e28c9/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.585570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdce196d08d427ba094729a3d933732, user_id=a5e60c150c934f67813701a4844e28c9, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.588289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.590460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] MFA Rules not processed for user `03c4469dad944941823b6d78b9c9dfc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:53.591741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:53.607436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 954/1913] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:53 2022] PUT /identity/v3/projects/9fdce196d08d427ba094729a3d933732/users/a5e60c150c934f67813701a4844e28c9/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:53.608418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.690463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 960/1914] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:53.690463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.690793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d82ca-885b-48e2-aac2-ef0daa924b8b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.692320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:53.701039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.702084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.702241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.702544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] PATH_INFO: `/v3/projects/4edb224a061b4eabb828aec9f1cfb98d/users/8848ec125aee413e9ed830f9f1e5fe9c/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.722663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edb224a061b4eabb828aec9f1cfb98d, user_id=8848ec125aee413e9ed830f9f1e5fe9c, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.725527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.744193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 955/1915] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:53 2022] PUT /identity/v3/projects/4edb224a061b4eabb828aec9f1cfb98d/users/8848ec125aee413e9ed830f9f1e5fe9c/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:53.745047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.771337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bf5f1-2f9f-43e5-8f74-e6d392232b37 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.785892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:53.828350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe265fa-a185-4c65-8231-fb1264c6d0a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.829010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe265fa-a185-4c65-8231-fb1264c6d0a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.829291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe265fa-a185-4c65-8231-fb1264c6d0a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.829600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe265fa-a185-4c65-8231-fb1264c6d0a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.832559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c07d44-1fe8-4db7-aadb-bdd992453332 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.837247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.837932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.838207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.838566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.839302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.840945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.853999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 956/1916] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:53.853999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.853999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:53.865768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d9d9a-1ed4-4e0e-ac68-9c80a949337e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.869326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.869963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.870246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.870551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.875129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:53.893064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe265fa-a185-4c65-8231-fb1264c6d0a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.894589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe265fa-a185-4c65-8231-fb1264c6d0a8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.904852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 961/1917] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:53.906140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1571e-6cfa-4aab-a1c4-bd500aadf295 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.906544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1571e-6cfa-4aab-a1c4-bd500aadf295 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.906828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1571e-6cfa-4aab-a1c4-bd500aadf295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.940281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.940531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fdc1571e-6cfa-4aab-a1c4-bd500aadf295 None None] MFA Rules not processed for user `8848ec125aee413e9ed830f9f1e5fe9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:53.942049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fdc1571e-6cfa-4aab-a1c4-bd500aadf295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:53.942144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:53.953085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 957/1918] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:53.953897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:53.965831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361bb99-88f3-49fd-8466-d0c11ca3215b service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:53.976222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:53.977495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:53.977797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:53.978159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] PATH_INFO: `/v3/projects/9fdce196d08d427ba094729a3d933732/users/a5e60c150c934f67813701a4844e28c9/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:53.981107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdce196d08d427ba094729a3d933732, user_id=a5e60c150c934f67813701a4844e28c9, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:53.986677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.006143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 958/1919] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:53 2022] PUT /identity/v3/projects/9fdce196d08d427ba094729a3d933732/users/a5e60c150c934f67813701a4844e28c9/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:54.006993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.031391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 962/1920] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:54.032798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7bd1e-430f-4001-93a1-8d9cd77af2ea None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.033086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7bd1e-430f-4001-93a1-8d9cd77af2ea None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.033362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7bd1e-430f-4001-93a1-8d9cd77af2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.072656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16391dc8-5889-4422-af8b-61bdaa08601a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.072792 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-52a7bd1e-430f-4001-93a1-8d9cd77af2ea None None] MFA Rules not processed for user `a5e60c150c934f67813701a4844e28c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:54.074092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-52a7bd1e-430f-4001-93a1-8d9cd77af2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:54.077711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.078659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.078914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.079192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.081451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:54.168607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 963/1921] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:54.171893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7bd1e-430f-4001-93a1-8d9cd77af2ea None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.172052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.174468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.186411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 959/1922] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:54.187286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.193441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:54.196871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de1211-2d9f-47dc-8631-0a22d707aa15 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.201177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.201848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.202451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.202892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.214839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.217785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.234438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 960/1923] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:54.279071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:54.285313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7bd1e-430f-4001-93a1-8d9cd77af2ea None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.292450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.293612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.293964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.294605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.295579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.297830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.336161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 964/1924] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:54 2022] POST /identity/v3/projects => generated 357 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:54.339803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.353796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68857b1-3eef-4fa8-b82b-d81090bd16a1 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.479338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.481067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.481512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.481813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.482940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.484965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.529202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 961/1925] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:54 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:27:54.530785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.544929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cda5d-3fd1-4b45-a001-f9188b08c077 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.554275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.555001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.555283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.555558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.557425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.559750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.591166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 965/1926] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:54.603034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.618092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d72d8a-6134-4d3c-ac79-c00dea6dbfa1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.629494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.630498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.630842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.631095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] PATH_INFO: `/v3/projects/1477b575bb674433ae70643f43d48122/users/5cbe7054b60c439287b7b4c44f7b759f/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.656514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1477b575bb674433ae70643f43d48122, user_id=5cbe7054b60c439287b7b4c44f7b759f, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.659515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.703975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 962/1927] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:54 2022] PUT /identity/v3/projects/1477b575bb674433ae70643f43d48122/users/5cbe7054b60c439287b7b4c44f7b759f/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:54.708115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.721017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.734298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c647-44f0-4efd-b956-93a3d10376cc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.883107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.884005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.885562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.897983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.899000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.899775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26190ef-1f38-4a54-bbd3-b4f2bb9db97a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.902790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.904732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.905640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.905920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.906191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] PATH_INFO: `/v3/users/afa54727cd47498d8a0642dfd9abfc73` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.922190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa54727cd47498d8a0642dfd9abfc73)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.925093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:54.935807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 966/1928] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:54.940379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:54.967624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb31985-da5a-45c1-b33d-3a6fd62544fd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:54.983397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f1b70-93a9-419a-9be6-e9be451534b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:54.984397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1b70-93a9-419a-9be6-e9be451534b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:54.984839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1b70-93a9-419a-9be6-e9be451534b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:54.985123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1b70-93a9-419a-9be6-e9be451534b4 admin admin] PATH_INFO: `/v3/projects/1477b575bb674433ae70643f43d48122/users/5cbe7054b60c439287b7b4c44f7b759f/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:54.989582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f1b70-93a9-419a-9be6-e9be451534b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1477b575bb674433ae70643f43d48122, user_id=5cbe7054b60c439287b7b4c44f7b759f, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:54.994215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17f1b70-93a9-419a-9be6-e9be451534b4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:55.022358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 967/1929] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:54 2022] PUT /identity/v3/projects/1477b575bb674433ae70643f43d48122/users/5cbe7054b60c439287b7b4c44f7b759f/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:55.024067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e401-07b9-411d-b32a-1d7a4ae5017e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.024360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e401-07b9-411d-b32a-1d7a4ae5017e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.024903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6e401-07b9-411d-b32a-1d7a4ae5017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.042162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa54727cd47498d8a0642dfd9abfc73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.042162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa54727cd47498d8a0642dfd9abfc73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.042162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa54727cd47498d8a0642dfd9abfc73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.051900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa54727cd47498d8a0642dfd9abfc73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.055230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:55.066779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ace6e401-07b9-411d-b32a-1d7a4ae5017e None None] MFA Rules not processed for user `5cbe7054b60c439287b7b4c44f7b759f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:55.068154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ace6e401-07b9-411d-b32a-1d7a4ae5017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.078084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa54727cd47498d8a0642dfd9abfc73'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.100348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 963/1930] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:54 2022] DELETE /identity/v3/users/afa54727cd47498d8a0642dfd9abfc73 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:55.101368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:55.103359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.161243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 968/1931] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:55 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:55.161243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.161243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.161243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.181970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:55.182330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8a5f7-81f5-48da-81cb-b458ead4505d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:55.183193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.187492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:55.188396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.188665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.188960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] PATH_INFO: `/v3/users/f2722f6db08d4ba0b50f28d2ff1192f0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.190175 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2722f6db08d4ba0b50f28d2ff1192f0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:55.192148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:55.196018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 969/1932] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:55.196913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:55.198272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.234465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:55.244357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2722f6db08d4ba0b50f28d2ff1192f0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.245108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2722f6db08d4ba0b50f28d2ff1192f0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.245906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2722f6db08d4ba0b50f28d2ff1192f0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.254669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2722f6db08d4ba0b50f28d2ff1192f0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.260997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d19e6-d8da-4404-ac21-72c4feb7973f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:55.265428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d01ccb-038e-4911-b53c-f05f9a657f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:55.266090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d01ccb-038e-4911-b53c-f05f9a657f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.266402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d01ccb-038e-4911-b53c-f05f9a657f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.266702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d01ccb-038e-4911-b53c-f05f9a657f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.268867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-07d01ccb-038e-4911-b53c-f05f9a657f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.278940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2722f6db08d4ba0b50f28d2ff1192f0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:55.320854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 964/1933] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:55 2022] DELETE /identity/v3/users/f2722f6db08d4ba0b50f28d2ff1192f0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:55.321820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:55.328822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.383560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d01ccb-038e-4911-b53c-f05f9a657f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:55.385530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d01ccb-038e-4911-b53c-f05f9a657f85 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:55.399486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 970/1934] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:55 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:55.401763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.402273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.402907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.413075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006c4bf-5b40-4bfa-a984-c73606353b70 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:55.417955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:55.419054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.420203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.420486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.422975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.429686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:55.431316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.431640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:55.509222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:55.511107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:55.523609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 965/1935] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:55.527362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:55.529681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 971/1936] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:55.531347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.539644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:55.541171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.554420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da2768-eafb-4d77-bd98-19ca0b5be6a6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:55.558682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:55.559517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.559887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.560339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.574042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:55.575621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:55.588674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 972/1937] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:55.606683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a3a62-8796-4fc2-a30f-87052aada287 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:55.612076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:55.612783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.613213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.613491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.615584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.697088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:55.699175 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:55.713810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 966/1938] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:55 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:55.920188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:55.922134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:55.955094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc95fc6-6062-4c4b-9aba-ebe60421fad3 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:55.961667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:55.963457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:55.963845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:55.964221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] PATH_INFO: `/v3/projects/0c0f512617f04849bef57850dd39ae7a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:55.965932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0f512617f04849bef57850dd39ae7a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:55.968986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:56.076431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0f512617f04849bef57850dd39ae7a', 'request_id': 'req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.090588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0f512617f04849bef57850dd39ae7a', 'request_id': 'req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.099746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:56.102501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0f512617f04849bef57850dd39ae7a', 'request_id': 'req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.120156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] The token cache is being invalidate because project 0c0f512617f04849bef57850dd39ae7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:56.120514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.121384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-da8a91e3-dee0-46c2-8be8-4ef5b04d2ad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.128560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 973/1939] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:55 2022] DELETE /identity/v3/projects/0c0f512617f04849bef57850dd39ae7a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:56.129520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:56.145894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef071eb-edf9-4aa6-8f08-7dffedd54807 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:56.224500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:56.233283 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:56.234493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:56.234995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:56.235608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] PATH_INFO: `/v3/users/a5e60c150c934f67813701a4844e28c9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:56.237267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e60c150c934f67813701a4844e28c9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:56.239838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:56.360735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e60c150c934f67813701a4844e28c9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.362657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e60c150c934f67813701a4844e28c9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.363528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e60c150c934f67813701a4844e28c9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.383984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e60c150c934f67813701a4844e28c9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.413467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-68126812-99a5-4c0b-9558-c83b366c6901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e60c150c934f67813701a4844e28c9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:56.448917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 967/1940] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:56 2022] DELETE /identity/v3/users/a5e60c150c934f67813701a4844e28c9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:56.786846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c960-f4d7-4d38-89e6-f01c8fa5d869 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:56.787178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c960-f4d7-4d38-89e6-f01c8fa5d869 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:56.787407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48c960-f4d7-4d38-89e6-f01c8fa5d869 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:56.789236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 974/1941] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:27:56.807458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:56.807999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:56.809310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:56.845128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:56.847850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:56.954533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 968/1942] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:27:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:56.974091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48c960-f4d7-4d38-89e6-f01c8fa5d869 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:56.979994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dd48c960-f4d7-4d38-89e6-f01c8fa5d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:57.008628 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48c960-f4d7-4d38-89e6-f01c8fa5d869 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:57.015977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:57.017074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:57.017583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:57.018055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:57.031503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:57.035370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:57.070948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 975/1943] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:57.174586 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:57.176227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:57.353472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c674a9-77f5-4732-bef1-76255648f3d7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:57.366002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:57.368457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:57.369609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:57.370672 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] PATH_INFO: `/v3/projects/d3835bd101f14fe6832cc998d46a42c8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:57.374934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3835bd101f14fe6832cc998d46a42c8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:57.388862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:57.414160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:57.486812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3835bd101f14fe6832cc998d46a42c8', 'request_id': 'req-3665bfdc-c64e-4d71-bfdc-1243149e6873'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.495620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3835bd101f14fe6832cc998d46a42c8', 'request_id': 'req-3665bfdc-c64e-4d71-bfdc-1243149e6873'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.504189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3835bd101f14fe6832cc998d46a42c8', 'request_id': 'req-3665bfdc-c64e-4d71-bfdc-1243149e6873'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.518885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] The token cache is being invalidate because project d3835bd101f14fe6832cc998d46a42c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:57.519195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.520335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.521929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 969/1944] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:57 2022] DELETE /identity/v3/projects/d3835bd101f14fe6832cc998d46a42c8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:57.526647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:57.542524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5422ce-5dbb-439e-8d0d-7abd9b3876ac service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:57.664449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:57.665340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:57.665815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:57.666179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] PATH_INFO: `/v3/users/ab2856e6885341bba9895aeaed424457` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:57.670872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2856e6885341bba9895aeaed424457)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:57.673079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:57.764030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:57.767371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:57.782843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665bfdc-c64e-4d71-bfdc-1243149e6873 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:57.797960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:57.799401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:57.799899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:57.800383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] PATH_INFO: `/v3/users/004de6c2af5549249702ce385cfa3955` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:57.802429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2856e6885341bba9895aeaed424457'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.803535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=004de6c2af5549249702ce385cfa3955)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:57.805703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:57.814635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2856e6885341bba9895aeaed424457'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.840985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2856e6885341bba9895aeaed424457'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.849889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2856e6885341bba9895aeaed424457'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.852078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2856e6885341bba9895aeaed424457'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.871596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 976/1945] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:57 2022] DELETE /identity/v3/users/ab2856e6885341bba9895aeaed424457 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:57.871596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:57.871596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:57.954647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:57.957857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004de6c2af5549249702ce385cfa3955'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.971815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004de6c2af5549249702ce385cfa3955'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.972602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004de6c2af5549249702ce385cfa3955'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:57.973679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b3d5a-f6b7-4df0-a93b-38daaa513792 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:57.983948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:57.985109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:57.986409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:57.986830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] PATH_INFO: `/v3/projects/9fdce196d08d427ba094729a3d933732` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:57.988783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdce196d08d427ba094729a3d933732)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:57.991610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:57.995224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004de6c2af5549249702ce385cfa3955'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.010417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-af30e09e-a4e4-4249-94a6-1c9a4343f941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004de6c2af5549249702ce385cfa3955'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.029911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 970/1946] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:57 2022] DELETE /identity/v3/users/004de6c2af5549249702ce385cfa3955 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:58.034913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.035417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.035855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.057984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdce196d08d427ba094729a3d933732', 'request_id': 'req-af144595-3105-4d7a-bcbe-58e1216fcc9e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.058666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:58.059614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:58.070344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdce196d08d427ba094729a3d933732', 'request_id': 'req-af144595-3105-4d7a-bcbe-58e1216fcc9e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.077619 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdce196d08d427ba094729a3d933732', 'request_id': 'req-af144595-3105-4d7a-bcbe-58e1216fcc9e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.092973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] The token cache is being invalidate because project 9fdce196d08d427ba094729a3d933732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:58.094776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.095961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-af144595-3105-4d7a-bcbe-58e1216fcc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.103075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 977/1947] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:57 2022] DELETE /identity/v3/projects/9fdce196d08d427ba094729a3d933732 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:58.106577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731374ec-3d1e-4a4d-b011-8ffa69e47b6b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.106839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731374ec-3d1e-4a4d-b011-8ffa69e47b6b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.108307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731374ec-3d1e-4a4d-b011-8ffa69e47b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.135126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 971/1948] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:58.135422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-731374ec-3d1e-4a4d-b011-8ffa69e47b6b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:58.136915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-731374ec-3d1e-4a4d-b011-8ffa69e47b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:58.147797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.150341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:58.162616 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 978/1949] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:58.172070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea73a55-2cca-46a2-89a5-c7751338c635 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.172410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:58.173181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea73a55-2cca-46a2-89a5-c7751338c635 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.173497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea73a55-2cca-46a2-89a5-c7751338c635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.199268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0ea73a55-2cca-46a2-89a5-c7751338c635 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:58.201102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0ea73a55-2cca-46a2-89a5-c7751338c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:58.212061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 979/1950] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:27:58.217079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea73a55-2cca-46a2-89a5-c7751338c635 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.241186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea73a55-2cca-46a2-89a5-c7751338c635 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.252666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.255308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.256345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.256955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.259147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:58.260155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.265768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.308761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736da57e-d283-4212-8556-3f4652ba9da8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.310946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 980/1951] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:58.314860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.316608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.321608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.322141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.322615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.338240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73186-6d37-4aab-a6f0-0a73d5c93216 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.345474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.350664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.350664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.351182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.354744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.355151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.356259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.360457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.382193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 972/1952] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:27:58.412903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 981/1953] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:58 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:58.417358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.432227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caefd37-fc2d-4687-9bac-f66d44399feb service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.553961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.554698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.554983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.555259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.555977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.557938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.605283 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 973/1954] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:58 2022] POST /identity/v3/users => generated 304 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:58.609438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.616367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.618734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:58.629170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f978b4-3302-40cb-bea1-c0cb13707537 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.638375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fcfb3-a644-482c-b23a-6d370339ec42 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.644035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.644956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.645590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.646419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.646726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.648199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.648972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.649264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.649615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] PATH_INFO: `/v3/projects/ddd92baabe754752a2f71a98cc602b6f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.652991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd92baabe754752a2f71a98cc602b6f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.653612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.656031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.677194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 982/1955] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:58.682210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.717917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259857f3-7d75-4fc2-a6d1-fb5dd50bafaa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.741645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.742571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.743085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.743462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.744311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.749187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.765062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd92baabe754752a2f71a98cc602b6f', 'request_id': 'req-a8462bf0-d291-4477-9783-1c49f8463b6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.773840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 983/1956] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:58.778172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd92baabe754752a2f71a98cc602b6f', 'request_id': 'req-a8462bf0-d291-4477-9783-1c49f8463b6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.782485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:58.789341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd92baabe754752a2f71a98cc602b6f', 'request_id': 'req-a8462bf0-d291-4477-9783-1c49f8463b6b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.809394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147adb5-e9dc-4805-83c9-b2ded88df693 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:58.812866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] The token cache is being invalidate because project ddd92baabe754752a2f71a98cc602b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:58.814514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.815585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a8462bf0-d291-4477-9783-1c49f8463b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:58.819363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 974/1957] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:58 2022] DELETE /identity/v3/projects/ddd92baabe754752a2f71a98cc602b6f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:58.828848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da47121-4e98-48b4-9755-da847515cf14 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.829140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da47121-4e98-48b4-9755-da847515cf14 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.831750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da47121-4e98-48b4-9755-da847515cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.910529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c34282-3217-4985-9d10-3e91c28718b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:58.911141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5da47121-4e98-48b4-9755-da847515cf14 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:58.912714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c34282-3217-4985-9d10-3e91c28718b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.913489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5da47121-4e98-48b4-9755-da847515cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:58.913896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c34282-3217-4985-9d10-3e91c28718b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.914859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c34282-3217-4985-9d10-3e91c28718b8 admin admin] PATH_INFO: `/v3/projects/4f78c8232d004e78b5cace3f9bc8a43f/users/71eb5e189680489b83f34becca2609e3/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.952508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 975/1958] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:58.955024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:58.955316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:58.957548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:58.968358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c34282-3217-4985-9d10-3e91c28718b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f78c8232d004e78b5cace3f9bc8a43f, user_id=71eb5e189680489b83f34becca2609e3, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:58.978232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c34282-3217-4985-9d10-3e91c28718b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:58.992468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:59.002263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:59.012084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 984/1959] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:58 2022] PUT /identity/v3/projects/4f78c8232d004e78b5cace3f9bc8a43f/users/71eb5e189680489b83f34becca2609e3/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:59.012413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.015781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018182c-5e31-4f46-97a9-9d30c7a1c41d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.016318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018182c-5e31-4f46-97a9-9d30c7a1c41d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.016740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018182c-5e31-4f46-97a9-9d30c7a1c41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.039386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:59.077504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7018182c-5e31-4f46-97a9-9d30c7a1c41d None None] MFA Rules not processed for user `71eb5e189680489b83f34becca2609e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:27:59.081734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7018182c-5e31-4f46-97a9-9d30c7a1c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.152657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 976/1960] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:27:59.152657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.152657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.167753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc69da-7018-4fad-8b16-27e692dbdea4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.173777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.174924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.175218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.175507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] PATH_INFO: `/v3/projects/cb46f3d12b934a7ab65cce100d708d57` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.176735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb46f3d12b934a7ab65cce100d708d57)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.178698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.212356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 985/1961] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:27:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:27:59.213410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018182c-5e31-4f46-97a9-9d30c7a1c41d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.228617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018182c-5e31-4f46-97a9-9d30c7a1c41d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.240568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb46f3d12b934a7ab65cce100d708d57', 'request_id': 'req-59d6d321-2d55-4504-8967-e534b7601416'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.247258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb46f3d12b934a7ab65cce100d708d57', 'request_id': 'req-59d6d321-2d55-4504-8967-e534b7601416'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.260989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb46f3d12b934a7ab65cce100d708d57', 'request_id': 'req-59d6d321-2d55-4504-8967-e534b7601416'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.290936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] The token cache is being invalidate because project cb46f3d12b934a7ab65cce100d708d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:59.291239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.291982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.296773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 977/1962] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:59 2022] DELETE /identity/v3/projects/cb46f3d12b934a7ab65cce100d708d57 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:59.297591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.300771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.308230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.309167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.309598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.310059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.311060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:27:59.311554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.313187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.328998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 986/1963] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:27:59.329908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.331702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.344795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca29ee0-d954-4197-8b29-de34a9f99e38 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.349754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.350702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.350982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.351258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] PATH_INFO: `/v3/users/d94fb2f012184c098c7689ee7ae28c13` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.352473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94fb2f012184c098c7689ee7ae28c13)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.354449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.372598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6d321-2d55-4504-8967-e534b7601416 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.377606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.378280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.378592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.378883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.379577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.381502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.406697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94fb2f012184c098c7689ee7ae28c13'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.411310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 978/1964] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:59 2022] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:59.412336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.413925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.419185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94fb2f012184c098c7689ee7ae28c13'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.432461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94fb2f012184c098c7689ee7ae28c13'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.437891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:59.441017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94fb2f012184c098c7689ee7ae28c13'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.443438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94fb2f012184c098c7689ee7ae28c13'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.446095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:59.455389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 987/1965] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:27:59 2022] DELETE /identity/v3/users/d94fb2f012184c098c7689ee7ae28c13 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:59.455389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.455389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.487910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02e5bb-d389-49fd-b460-de70fd31321c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.544311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86d92b-0ebb-4102-9e8c-9620348ad51e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.553098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.553808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.554090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.554412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.555115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.557143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.567644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.568843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.569447 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.570499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.570916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.573384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.591206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 988/1966] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:59 2022] POST /identity/v3/users => generated 311 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:59.598896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.606771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a43df-3d0f-4d5a-beed-45ce45ea93bf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.612232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 979/1967] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:27:59 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:59.614913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.616767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.617382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.618446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.618981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.619828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.620077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.624118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.664445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 989/1968] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:59.665558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.679449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163133a6-ddfa-43fd-a7c2-98e9e30e5007 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.702509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0fc1d-1505-4647-933c-80f2b74a4a81 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.708375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.709174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.709557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.709964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.710832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.712987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.740363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 980/1969] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:27:59 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:27:59.744235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.753786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.754727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.755008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.755282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] PATH_INFO: `/v3/projects/9419625d31f2466abd60d4d61cc1fc09/users/2ab199287b3e4eeeaea35715d256a71f/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.757024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751edaa-3226-4d06-ad9f-eb0bc2141a2d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.763310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.764574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.764763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.765147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.766215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.768509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.771866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9419625d31f2466abd60d4d61cc1fc09, user_id=2ab199287b3e4eeeaea35715d256a71f, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.774658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.781073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 981/1970] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:27:59.786049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.794393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 990/1971] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:59 2022] PUT /identity/v3/projects/9419625d31f2466abd60d4d61cc1fc09/users/2ab199287b3e4eeeaea35715d256a71f/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:59.794762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.796796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.800436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2fba7-b2d5-4581-9441-efd3e0af69f0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.843635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:59.863612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:27:59.866460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.867152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.867440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.867672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713bb0d-880a-453f-a5f2-af35a6c2b9d9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.867792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.868460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.870067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.873524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.874424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.874699 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.874965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] PATH_INFO: `/v3/projects/490cc645f9a14bb08bf868177fe7ac0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.876130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=490cc645f9a14bb08bf868177fe7ac0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.878403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.884469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 982/1972] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:27:59.884469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.891812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268c36-a152-49a8-bae8-793902431a32 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.897335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.898022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.898340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.898645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.899373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.901030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:27:59.911503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 983/1973] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:27:59.912156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.922593 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2765f-3b08-4d5a-bf5c-3db1fbd8c969 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:27:59.927167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490cc645f9a14bb08bf868177fe7ac0a', 'request_id': 'req-416e085e-2ef0-4ec2-8663-2a8b3613a75b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.936014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490cc645f9a14bb08bf868177fe7ac0a', 'request_id': 'req-416e085e-2ef0-4ec2-8663-2a8b3613a75b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.941711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490cc645f9a14bb08bf868177fe7ac0a', 'request_id': 'req-416e085e-2ef0-4ec2-8663-2a8b3613a75b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.952970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] The token cache is being invalidate because project 490cc645f9a14bb08bf868177fe7ac0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:27:59.953258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.953916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:27:59.955563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 991/1974] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:27:59 2022] DELETE /identity/v3/projects/490cc645f9a14bb08bf868177fe7ac0a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:27:59.956375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:27:59.957796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:27:59.980230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:27:59.981143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:27:59.981424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:27:59.981699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] PATH_INFO: `/v3/projects/33e6c34c333147e6a703cd2e9e1ceb09/users/fca528490bf54177a931f84c8e76dc70/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:27:59.996889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e6c34c333147e6a703cd2e9e1ceb09, user_id=fca528490bf54177a931f84c8e76dc70, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:27:59.999664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:00.014075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 984/1975] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:59 2022] PUT /identity/v3/projects/33e6c34c333147e6a703cd2e9e1ceb09/users/fca528490bf54177a931f84c8e76dc70/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:00.015073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:00.016749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:00.023031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e085e-2ef0-4ec2-8663-2a8b3613a75b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:00.084640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db4819-f167-48ea-bb8d-880ed2ec98ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:00.086223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db4819-f167-48ea-bb8d-880ed2ec98ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:00.086764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db4819-f167-48ea-bb8d-880ed2ec98ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:00.087527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db4819-f167-48ea-bb8d-880ed2ec98ed admin admin] PATH_INFO: `/v3/projects/9419625d31f2466abd60d4d61cc1fc09/users/2ab199287b3e4eeeaea35715d256a71f/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:00.089983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db4819-f167-48ea-bb8d-880ed2ec98ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9419625d31f2466abd60d4d61cc1fc09, user_id=2ab199287b3e4eeeaea35715d256a71f, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:00.093003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db4819-f167-48ea-bb8d-880ed2ec98ed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:00.101979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f298b-c22a-48b5-bedc-71d564470ea2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:00.108516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 992/1976] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:27:59 2022] PUT /identity/v3/projects/9419625d31f2466abd60d4d61cc1fc09/users/2ab199287b3e4eeeaea35715d256a71f/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:00.110087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780931a-6fdd-4cf9-8167-c62e0b4d85af None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:00.110610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780931a-6fdd-4cf9-8167-c62e0b4d85af None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:00.111067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780931a-6fdd-4cf9-8167-c62e0b4d85af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:00.133674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3780931a-6fdd-4cf9-8167-c62e0b4d85af None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:00.135386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3780931a-6fdd-4cf9-8167-c62e0b4d85af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:00.176568 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:00.185312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:00.190785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:00.191700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:00.192168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:00.192450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] PATH_INFO: `/v3/users/03c4469dad944941823b6d78b9c9dfc9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:00.193902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c4469dad944941823b6d78b9c9dfc9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:00.196853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:00.244162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 993/1977] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:00.245757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:00.246046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:00.246345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:00.268280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c4469dad944941823b6d78b9c9dfc9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:00.275684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c4469dad944941823b6d78b9c9dfc9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:00.275684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c4469dad944941823b6d78b9c9dfc9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:00.290925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] MFA Rules not processed for user `2ab199287b3e4eeeaea35715d256a71f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:00.292677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:00.293292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c4469dad944941823b6d78b9c9dfc9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:00.321821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c4469dad944941823b6d78b9c9dfc9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:00.356526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 985/1978] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:00 2022] DELETE /identity/v3/users/03c4469dad944941823b6d78b9c9dfc9 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:00.361713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:00.361713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:00.423469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 994/1979] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:00.437346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:00.441589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:00.514602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6ba98-6c08-4314-88e5-2149b4549d6c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:00.528868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:00.530000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:00.530507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:00.530794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:00.535992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:00.546932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fd533-4cfd-4a12-9d3e-ad48e9cb669e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:00.676046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:00.676844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:00.677382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:00.677757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:00.688305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:00.690564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:00.727991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:00.732616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 986/1980] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:00.834411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:00.835798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:00.847573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 995/1981] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:01.082509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:01.097605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbd262-e68b-402a-b81a-7583c2c4baa0 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:01.108713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:01.110182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:01.111984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d066c-fda6-4dfe-b903-57b72eeb0ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:01.112651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d066c-fda6-4dfe-b903-57b72eeb0ecf service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:01.112926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d066c-fda6-4dfe-b903-57b72eeb0ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:01.113202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d066c-fda6-4dfe-b903-57b72eeb0ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:01.122563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-999d066c-fda6-4dfe-b903-57b72eeb0ecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:01.129564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfca9e-171a-470b-bb31-805c31669bc3 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:01.153388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:01.155416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:01.155711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:01.156060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] PATH_INFO: `/v3/projects/8dd0a84db60241b9a3c716f3ad7de6f7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:01.158380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd0a84db60241b9a3c716f3ad7de6f7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:01.160687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:01.168774 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:01.252867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d066c-fda6-4dfe-b903-57b72eeb0ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:01.254671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d066c-fda6-4dfe-b903-57b72eeb0ecf service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:01.266265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd0a84db60241b9a3c716f3ad7de6f7', 'request_id': 'req-d1df491c-e7dc-467c-a953-a395c897d3ae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:01.279796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 987/1982] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:01.293028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd0a84db60241b9a3c716f3ad7de6f7', 'request_id': 'req-d1df491c-e7dc-467c-a953-a395c897d3ae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:01.305272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd0a84db60241b9a3c716f3ad7de6f7', 'request_id': 'req-d1df491c-e7dc-467c-a953-a395c897d3ae'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:01.341274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] The token cache is being invalidate because project 8dd0a84db60241b9a3c716f3ad7de6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:01.342707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:01.344656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d1df491c-e7dc-467c-a953-a395c897d3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:01.355814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 996/1983] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:01 2022] DELETE /identity/v3/projects/8dd0a84db60241b9a3c716f3ad7de6f7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:01.358548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08681e-3450-4d00-8baf-cf065a3318f0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:01.358919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08681e-3450-4d00-8baf-cf065a3318f0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:01.359276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08681e-3450-4d00-8baf-cf065a3318f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:01.391380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cf08681e-3450-4d00-8baf-cf065a3318f0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:01.400145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cf08681e-3450-4d00-8baf-cf065a3318f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:01.556886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 988/1984] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:01.566244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35586a-d741-4b51-8ed7-dd1492e7b5be None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:01.566594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35586a-d741-4b51-8ed7-dd1492e7b5be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:01.566846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35586a-d741-4b51-8ed7-dd1492e7b5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:01.622940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cf35586a-d741-4b51-8ed7-dd1492e7b5be None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:01.624334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf35586a-d741-4b51-8ed7-dd1492e7b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:01.639681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 997/1985] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:01.644521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08681e-3450-4d00-8baf-cf065a3318f0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:01.665740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08681e-3450-4d00-8baf-cf065a3318f0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:01.684951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:01.685697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:01.685982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:01.686317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:01.687073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:01.687384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:01.689213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:01.714065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 989/1986] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:01.719042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35586a-d741-4b51-8ed7-dd1492e7b5be None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:01.741096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35586a-d741-4b51-8ed7-dd1492e7b5be None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:01.746412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:01.747124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:01.747413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:01.747694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:01.748439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:01.750397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:01.821150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 998/1987] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:01 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:01.823077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:01.849027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c8a38-93b6-4a32-b93e-1c016bbd32cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:01.986509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:01.988199 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:01.988737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:01.989115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:01.989933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:01.999466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.043574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 990/1988] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:01 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:02.045048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.058554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61c2d8-f99a-49ea-abdb-f22f2f61c92d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.064343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.065298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.065658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.066003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.066961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.068656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.081492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 999/1989] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:02.085620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.097692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939d23d-9767-424c-a11e-5466a4a6843b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.104705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231803-3082-42ac-9d7d-e84b9a0363d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.105430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231803-3082-42ac-9d7d-e84b9a0363d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.105775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231803-3082-42ac-9d7d-e84b9a0363d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.106113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231803-3082-42ac-9d7d-e84b9a0363d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.107305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231803-3082-42ac-9d7d-e84b9a0363d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.109498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231803-3082-42ac-9d7d-e84b9a0363d8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.122848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 991/1990] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:02.129143 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.143274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102b612-b43e-4caf-8eeb-9a27ceffc5a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.149950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c5744-9969-42f9-aac6-47e37427a199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.150976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c5744-9969-42f9-aac6-47e37427a199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.151399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c5744-9969-42f9-aac6-47e37427a199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.151802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c5744-9969-42f9-aac6-47e37427a199 admin admin] PATH_INFO: `/v3/projects/24881a3a0d324a2a9c6caeeafe331245/users/514f1a8338844e6ba26498c9450bd5fd/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.171072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c5744-9969-42f9-aac6-47e37427a199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24881a3a0d324a2a9c6caeeafe331245, user_id=514f1a8338844e6ba26498c9450bd5fd, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.174279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c5744-9969-42f9-aac6-47e37427a199 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.192832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1000/1991] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:02 2022] PUT /identity/v3/projects/24881a3a0d324a2a9c6caeeafe331245/users/514f1a8338844e6ba26498c9450bd5fd/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:02.206973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce0d13-366e-4455-9438-78666c969b94 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.207265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce0d13-366e-4455-9438-78666c969b94 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.207541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce0d13-366e-4455-9438-78666c969b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.243787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80ce0d13-366e-4455-9438-78666c969b94 None None] MFA Rules not processed for user `514f1a8338844e6ba26498c9450bd5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:02.244979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80ce0d13-366e-4455-9438-78666c969b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:02.264729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:02.317355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.318785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.319500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.336759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 992/1992] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:02.341772 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce0d13-366e-4455-9438-78666c969b94 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.359849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] MFA Rules not processed for user `fca528490bf54177a931f84c8e76dc70`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:02.362587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:02.404853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:02.436353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce0d13-366e-4455-9438-78666c969b94 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.442126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.443594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.444253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.444253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.445316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.447084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.458821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1001/1993] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:02.460354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.461831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:02.477424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcbd27-0e5f-425a-9c62-9832dd36a570 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.480923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 993/1994] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:02 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:02.482788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.483782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.483960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.484425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.484880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.485352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.487104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.520392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1002/1995] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:02 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:02.521339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.564627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cfa85-75e2-44f0-93be-49e1336c3a9d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.608349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9d1e9-9a1d-419c-9950-60540a8b5712 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.613375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.614051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.614411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.614689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.615707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.619306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.640816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:02.647110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1003/1996] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:02 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:02.650736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.656833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.657783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.658369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.658647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.659347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.661507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.662846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7903-ccfa-4ec6-8b3f-2f781e51b98b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.667930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.668267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.668553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.668827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.669593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.671234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.688317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1004/1997] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:02.690499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 994/1998] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:02 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:02.692383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.692996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.704114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aa868-c3d1-4838-b04f-3e070276119d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.706648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eef8f5-15fc-416e-9446-4273abb7a627 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.709954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.710920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.711207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.711487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] PATH_INFO: `/v3/projects/3fcdcb2755f449dbba61e584d272abdf/users/80c62f46d0224814925b7e52779c3d32/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.714376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.715548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.716033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.716510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.717552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.719526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.730692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcdcb2755f449dbba61e584d272abdf, user_id=80c62f46d0224814925b7e52779c3d32, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.734068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 995/1999] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:02.737532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.738730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.756115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fefb6-8eed-4ba7-9862-c8ca942e8aa1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.758214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1005/2000] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:02 2022] PUT /identity/v3/projects/3fcdcb2755f449dbba61e584d272abdf/users/80c62f46d0224814925b7e52779c3d32/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:02.763588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.836098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c391f03-c2a0-4504-bce6-eb1a825adfa1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.841467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.842394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.842677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.842956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.843702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.845557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.848318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.849304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.849493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:02.849591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.849841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] PATH_INFO: `/v3/projects/538683067b3a43ec963571951bb55d0a/users/7fd979c271284d7f89141c6df1ed856b/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.866939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1006/2001] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:02.868044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.869251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=538683067b3a43ec963571951bb55d0a, user_id=7fd979c271284d7f89141c6df1ed856b, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.873733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.881142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289e87-2d4d-4179-b825-bbcc313f4d4b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:02.887081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:02.888531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:02.888644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:02.889107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] PATH_INFO: `/v3/projects/3fcdcb2755f449dbba61e584d272abdf/users/80c62f46d0224814925b7e52779c3d32/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:02.891322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcdcb2755f449dbba61e584d272abdf, user_id=80c62f46d0224814925b7e52779c3d32, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:02.894452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:02.896187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 996/2002] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:02 2022] PUT /identity/v3/projects/538683067b3a43ec963571951bb55d0a/users/7fd979c271284d7f89141c6df1ed856b/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:02.900158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:02.906876 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1007/2003] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:02 2022] PUT /identity/v3/projects/3fcdcb2755f449dbba61e584d272abdf/users/80c62f46d0224814925b7e52779c3d32/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:02.973747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39102e-ac1e-4a07-ae64-98c4be57ebdf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:03.071302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48807b91-62c8-48a4-8de7-03d15d3a0e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:03.072127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48807b91-62c8-48a4-8de7-03d15d3a0e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:03.072414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48807b91-62c8-48a4-8de7-03d15d3a0e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:03.072753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48807b91-62c8-48a4-8de7-03d15d3a0e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:03.073563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48807b91-62c8-48a4-8de7-03d15d3a0e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:03.075263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48807b91-62c8-48a4-8de7-03d15d3a0e7e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:03.077155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:03.093569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 997/2004] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:03.094254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:03.128701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0be90-388d-4910-bc43-77d0004756b2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:03.137784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:03.137784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:03.137784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:03.138398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] PATH_INFO: `/v3/projects/538683067b3a43ec963571951bb55d0a/users/7fd979c271284d7f89141c6df1ed856b/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:03.140663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538683067b3a43ec963571951bb55d0a, user_id=7fd979c271284d7f89141c6df1ed856b, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:03.147057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:03.196422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320499c-ad11-45bf-aa35-643f64481f45 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:03.197224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320499c-ad11-45bf-aa35-643f64481f45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:03.197748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320499c-ad11-45bf-aa35-643f64481f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:03.205733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1008/2005] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:03 2022] PUT /identity/v3/projects/538683067b3a43ec963571951bb55d0a/users/7fd979c271284d7f89141c6df1ed856b/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:03.269779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b320499c-ad11-45bf-aa35-643f64481f45 None None] MFA Rules not processed for user `7fd979c271284d7f89141c6df1ed856b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:03.274122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b320499c-ad11-45bf-aa35-643f64481f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:03.542457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 998/2006] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:03.556263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:03.558151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:03.641587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786500e4-1630-4564-b902-6185aaa72c63 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:03.647634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c26551-7657-41c7-b379-e3b8b60b80cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:03.648784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c26551-7657-41c7-b379-e3b8b60b80cb service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:03.649240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c26551-7657-41c7-b379-e3b8b60b80cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:03.649715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c26551-7657-41c7-b379-e3b8b60b80cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:03.661858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c26551-7657-41c7-b379-e3b8b60b80cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:03.663716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c26551-7657-41c7-b379-e3b8b60b80cb service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:03.686658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1009/2007] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:03.915930 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320499c-ad11-45bf-aa35-643f64481f45 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:03.927414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320499c-ad11-45bf-aa35-643f64481f45 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:03.933842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10bb42-55df-4f64-a0fd-8e488156bdcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:03.934311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10bb42-55df-4f64-a0fd-8e488156bdcc service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:03.934700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10bb42-55df-4f64-a0fd-8e488156bdcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:03.934893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10bb42-55df-4f64-a0fd-8e488156bdcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:04.022792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10bb42-55df-4f64-a0fd-8e488156bdcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:04.025027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10bb42-55df-4f64-a0fd-8e488156bdcc service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:04.037297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 999/2008] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:04.146854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:04.147704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:04.148159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:04.186660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] MFA Rules not processed for user `80c62f46d0224814925b7e52779c3d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:04.188370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:04.347390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1010/2009] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:04.365686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73363dd-feff-45d2-a6c8-8fa322723d34 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:04.365986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73363dd-feff-45d2-a6c8-8fa322723d34 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:04.366300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73363dd-feff-45d2-a6c8-8fa322723d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:04.402968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c73363dd-feff-45d2-a6c8-8fa322723d34 None None] MFA Rules not processed for user `fca528490bf54177a931f84c8e76dc70`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:04.403931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c73363dd-feff-45d2-a6c8-8fa322723d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:04.518038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1000/2010] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:04.530458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:04.531964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:04.591205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73363dd-feff-45d2-a6c8-8fa322723d34 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:04.622909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:04.623324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:04.644273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011196da-8117-44bc-87c5-dc5a8fa40b56 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:04.651458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42aa611-f2ed-4494-b91e-d8d210c37bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:04.652150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aa611-f2ed-4494-b91e-d8d210c37bbc service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:04.652429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aa611-f2ed-4494-b91e-d8d210c37bbc service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:04.652897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42aa611-f2ed-4494-b91e-d8d210c37bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:04.662862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42aa611-f2ed-4494-b91e-d8d210c37bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:04.664606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42aa611-f2ed-4494-b91e-d8d210c37bbc service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:04.665785 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73363dd-feff-45d2-a6c8-8fa322723d34 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:04.671216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:04.672292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:04.672620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:04.672896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] PATH_INFO: `/v3/users/514f1a8338844e6ba26498c9450bd5fd` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:04.674713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514f1a8338844e6ba26498c9450bd5fd)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:04.676389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1011/2011] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:04.676695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:04.740481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514f1a8338844e6ba26498c9450bd5fd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:04.741193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514f1a8338844e6ba26498c9450bd5fd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:04.741805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514f1a8338844e6ba26498c9450bd5fd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:04.750808 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514f1a8338844e6ba26498c9450bd5fd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:04.770116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514f1a8338844e6ba26498c9450bd5fd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:04.791861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1001/2012] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:04 2022] DELETE /identity/v3/users/514f1a8338844e6ba26498c9450bd5fd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:04.797181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:04.798379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:04.798670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:04.817070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:04.818319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:04.889501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1012/2013] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:04.901947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:04.903673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:04.975169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140baf2-44ea-415c-90f7-2bc9de2fa672 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:04.979600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:04.980275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:04.980560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:04.980837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:04.997150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:04.999179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:05.009432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1002/2014] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:05.349183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:05.351425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:05.367339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76e761-dcfd-4a30-aaff-1682bc57c24f None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:05.373854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:05.374868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:05.375150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:05.375445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] PATH_INFO: `/v3/projects/24881a3a0d324a2a9c6caeeafe331245` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:05.377538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24881a3a0d324a2a9c6caeeafe331245)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:05.380664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:05.465569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24881a3a0d324a2a9c6caeeafe331245', 'request_id': 'req-26906240-9fd6-4f9a-8d0d-b0bde78fe401'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.477416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24881a3a0d324a2a9c6caeeafe331245', 'request_id': 'req-26906240-9fd6-4f9a-8d0d-b0bde78fe401'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.486955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24881a3a0d324a2a9c6caeeafe331245', 'request_id': 'req-26906240-9fd6-4f9a-8d0d-b0bde78fe401'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.499785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] The token cache is being invalidate because project 24881a3a0d324a2a9c6caeeafe331245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:05.500044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.500794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.502704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1013/2015] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:05 2022] DELETE /identity/v3/projects/24881a3a0d324a2a9c6caeeafe331245 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:05.506767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:05.519681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456f673-c057-4b5e-8c12-1ca586c48a19 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:05.583438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:05.618598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:05.620598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:05.622501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:05.623046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] PATH_INFO: `/v3/users/7fd979c271284d7f89141c6df1ed856b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:05.625458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd979c271284d7f89141c6df1ed856b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:05.633352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:05.738053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd979c271284d7f89141c6df1ed856b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.739166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd979c271284d7f89141c6df1ed856b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.739983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd979c271284d7f89141c6df1ed856b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.748779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd979c271284d7f89141c6df1ed856b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.781315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d26d878f-05b8-4322-a3bc-41cc9df38f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd979c271284d7f89141c6df1ed856b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:05.814977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1003/2016] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:05 2022] DELETE /identity/v3/users/7fd979c271284d7f89141c6df1ed856b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:06.103940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:06.105795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:06.129117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26906240-9fd6-4f9a-8d0d-b0bde78fe401 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:06.216883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:06.217976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.218489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.218963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] PATH_INFO: `/v3/projects/538683067b3a43ec963571951bb55d0a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.226552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538683067b3a43ec963571951bb55d0a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:06.226552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:06.240891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:06.279650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538683067b3a43ec963571951bb55d0a', 'request_id': 'req-ab31d204-c7d4-47b5-9979-8945a7f9d415'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:06.291095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538683067b3a43ec963571951bb55d0a', 'request_id': 'req-ab31d204-c7d4-47b5-9979-8945a7f9d415'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:06.296843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538683067b3a43ec963571951bb55d0a', 'request_id': 'req-ab31d204-c7d4-47b5-9979-8945a7f9d415'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:06.308429 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] The token cache is being invalidate because project 538683067b3a43ec963571951bb55d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:06.308727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:06.309425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ab31d204-c7d4-47b5-9979-8945a7f9d415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:06.311229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1014/2017] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:06 2022] DELETE /identity/v3/projects/538683067b3a43ec963571951bb55d0a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:06.316823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84231af5-61eb-40ff-bf96-4acd5571a21e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.317335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84231af5-61eb-40ff-bf96-4acd5571a21e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.317571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84231af5-61eb-40ff-bf96-4acd5571a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.335858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-84231af5-61eb-40ff-bf96-4acd5571a21e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:06.337048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-84231af5-61eb-40ff-bf96-4acd5571a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:06.398180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1004/2018] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:06.406344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76ede-23db-4276-90c0-96dbd5dc1019 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.406890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76ede-23db-4276-90c0-96dbd5dc1019 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.407105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a76ede-23db-4276-90c0-96dbd5dc1019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.427017 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-35a76ede-23db-4276-90c0-96dbd5dc1019 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:06.428237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-35a76ede-23db-4276-90c0-96dbd5dc1019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:06.437783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1015/2019] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:06.442334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84231af5-61eb-40ff-bf96-4acd5571a21e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:06.452515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84231af5-61eb-40ff-bf96-4acd5571a21e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:06.458087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:06.458971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.459256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.459532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.460269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:06.460633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:06.462388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:06.477249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1005/2020] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:06.481590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a76ede-23db-4276-90c0-96dbd5dc1019 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:06.491886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a76ede-23db-4276-90c0-96dbd5dc1019 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:06.497317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:06.498004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.498341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.498594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.499324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:06.501303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:06.530797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1016/2021] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:06 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:06.536090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:06.549940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235c2cb-8d66-44ab-b8e1-d270fa1db0ed admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:06.603711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:06.615589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:06.616419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.616807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.617260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.617962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:06.620572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:06.643598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1006/2022] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:06 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:06.647855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:06.660338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7315ab-fd46-40b7-bd0f-95fdd0f778c9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:06.665358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:06.666036 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.666381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.666661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.667401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:06.669023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:06.680590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1017/2023] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:06.684778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:06.695238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29676374-3771-4155-af33-0ee03ceae2e7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:06.700879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1236cc-1e1b-4c85-a135-5abb84c1abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:06.701554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1236cc-1e1b-4c85-a135-5abb84c1abfb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.701840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1236cc-1e1b-4c85-a135-5abb84c1abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.702147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1236cc-1e1b-4c85-a135-5abb84c1abfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.702920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1236cc-1e1b-4c85-a135-5abb84c1abfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:06.704543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1236cc-1e1b-4c85-a135-5abb84c1abfb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:06.715916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1007/2024] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:06.720074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:06.731659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1feece6-3714-4735-9b41-fd9e7b80bd9d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:06.737245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:06.738142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.738472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.738742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] PATH_INFO: `/v3/projects/1b9c7c116b3e4c10a44fbe40ffbc200e/users/8412e7e9e5524892947d4d30469bb546/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.755582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9c7c116b3e4c10a44fbe40ffbc200e, user_id=8412e7e9e5524892947d4d30469bb546, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:06.758090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:06.774142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1018/2025] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:06 2022] PUT /identity/v3/projects/1b9c7c116b3e4c10a44fbe40ffbc200e/users/8412e7e9e5524892947d4d30469bb546/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:06.785806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0d7a-fb87-45d9-bb2d-0563ccd0c773 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:06.786098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0d7a-fb87-45d9-bb2d-0563ccd0c773 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:06.786481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e0d7a-fb87-45d9-bb2d-0563ccd0c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:06.828733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8e3e0d7a-fb87-45d9-bb2d-0563ccd0c773 None None] MFA Rules not processed for user `8412e7e9e5524892947d4d30469bb546`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:06.831502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e3e0d7a-fb87-45d9-bb2d-0563ccd0c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:06.922651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1008/2026] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:06.928042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.005230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5595e-7ee2-488c-9e56-6ff1ed6619ec admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.010209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.010852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.011109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.011386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.012079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.013982 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.047767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1019/2027] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:06 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:07.049020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0d7a-fb87-45d9-bb2d-0563ccd0c773 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.061197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e0d7a-fb87-45d9-bb2d-0563ccd0c773 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.121633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.122365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.122654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.122933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.123666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.125614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.146972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1009/2028] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:07 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:07.151461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.174650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4018-e875-4948-aea4-db7a40474ea9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.180849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.181623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.182005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.182377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.183278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.184826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.198322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1020/2029] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:07.200669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.211456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa3dc3f-f6ce-468a-81c8-2bf143104fd3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.216224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.217157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.217433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.217705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] PATH_INFO: `/v3/projects/acd4f9a2d23e4fe1966dfdf4534455fb/users/55c418acb1004fba80576dbe5fcae7b4/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.234140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd4f9a2d23e4fe1966dfdf4534455fb, user_id=55c418acb1004fba80576dbe5fcae7b4, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.237149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.253064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1010/2030] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:07 2022] PUT /identity/v3/projects/acd4f9a2d23e4fe1966dfdf4534455fb/users/55c418acb1004fba80576dbe5fcae7b4/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:07.257396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.273533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b53d-776d-487b-affa-9725905b2b53 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.283050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:07.434557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62b946-94fa-4536-91a6-010ff8397d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.435265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b946-94fa-4536-91a6-010ff8397d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.435494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b946-94fa-4536-91a6-010ff8397d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.435681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62b946-94fa-4536-91a6-010ff8397d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.437293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62b946-94fa-4536-91a6-010ff8397d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.439916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62b946-94fa-4536-91a6-010ff8397d96 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.452343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1021/2031] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:07.458054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.469204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c96811-4654-4f9e-b180-e2f1447b61d6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.476029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.476948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.477514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.477514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] PATH_INFO: `/v3/projects/acd4f9a2d23e4fe1966dfdf4534455fb/users/55c418acb1004fba80576dbe5fcae7b4/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.479622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd4f9a2d23e4fe1966dfdf4534455fb, user_id=55c418acb1004fba80576dbe5fcae7b4, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.482836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.494502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1011/2032] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:07 2022] PUT /identity/v3/projects/acd4f9a2d23e4fe1966dfdf4534455fb/users/55c418acb1004fba80576dbe5fcae7b4/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:07.505049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.505335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.505618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.536338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] MFA Rules not processed for user `55c418acb1004fba80576dbe5fcae7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:07.538361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:07.547748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.552152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:07.570019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:07.665362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fd338-e9b2-4ddb-8183-4f15910b85df admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.672143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.673313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.673627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.674007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] PATH_INFO: `/v3/users/71eb5e189680489b83f34becca2609e3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.675384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71eb5e189680489b83f34becca2609e3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.679946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.689656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1022/2033] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:07.713513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.715837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:07.760120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71eb5e189680489b83f34becca2609e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:07.761467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71eb5e189680489b83f34becca2609e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:07.762630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71eb5e189680489b83f34becca2609e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:07.774252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71eb5e189680489b83f34becca2609e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:07.790690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed717ce-8b41-4708-bd01-4c2e943fdea5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:07.792645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-178bb198-1b80-4ee9-95b4-7d3e0fb9d2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71eb5e189680489b83f34becca2609e3'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:07.794409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:07.795103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.795392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.795664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.797781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:07.816373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1012/2034] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:07 2022] DELETE /identity/v3/users/71eb5e189680489b83f34becca2609e3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:07.821603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:07.822042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:07.822479 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:07.846851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:07.848332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:07.854181 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:07.871494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:07.873247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:07.883100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1023/2035] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:07.920945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1013/2036] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:07.930890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:07.933118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:08.014784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766067-0fbb-4fc2-927e-05174790b4c4 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:08.095623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:08.097215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:08.097215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:08.097215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:08.115538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:08.119813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:08.136868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1024/2037] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:09.203149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:09.204722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:09.217148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289477e-a377-49e0-97b2-fdc2b30f6a37 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:09.228607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:09.229537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:09.229823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:09.230101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] PATH_INFO: `/v3/projects/4f78c8232d004e78b5cace3f9bc8a43f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:09.231371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f78c8232d004e78b5cace3f9bc8a43f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:09.234010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:09.276534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:09.300823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f78c8232d004e78b5cace3f9bc8a43f', 'request_id': 'req-ecc3f46d-3c36-422c-a16e-f3906edb3615'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.306620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f78c8232d004e78b5cace3f9bc8a43f', 'request_id': 'req-ecc3f46d-3c36-422c-a16e-f3906edb3615'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.313474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f78c8232d004e78b5cace3f9bc8a43f', 'request_id': 'req-ecc3f46d-3c36-422c-a16e-f3906edb3615'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.330329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] The token cache is being invalidate because project 4f78c8232d004e78b5cace3f9bc8a43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:09.330922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.331789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.334473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1014/2038] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:09 2022] DELETE /identity/v3/projects/4f78c8232d004e78b5cace3f9bc8a43f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:09.338673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:09.353124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcec23-bbf5-4959-b033-cb4f53eedccd service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:09.469890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:09.471382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:09.471711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:09.471988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] PATH_INFO: `/v3/users/2ab199287b3e4eeeaea35715d256a71f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:09.473441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ab199287b3e4eeeaea35715d256a71f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:09.477147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:09.602779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:09.605076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ab199287b3e4eeeaea35715d256a71f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.621995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ab199287b3e4eeeaea35715d256a71f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.650186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ab199287b3e4eeeaea35715d256a71f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.667298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ab199287b3e4eeeaea35715d256a71f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.668358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-79affdc7-f710-46e4-a79a-ca04916120f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ab199287b3e4eeeaea35715d256a71f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:09.676817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1025/2039] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:09 2022] DELETE /identity/v3/users/2ab199287b3e4eeeaea35715d256a71f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:10.182310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:10.184023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:10.215478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3f46d-3c36-422c-a16e-f3906edb3615 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:10.362809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:10.364350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:10.364648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:10.364929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] PATH_INFO: `/v3/projects/9419625d31f2466abd60d4d61cc1fc09` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:10.370400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9419625d31f2466abd60d4d61cc1fc09)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:10.373318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:10.537362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9419625d31f2466abd60d4d61cc1fc09', 'request_id': 'req-dbee296e-272b-44c5-b55c-5bd0b80f425f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:10.547481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9419625d31f2466abd60d4d61cc1fc09', 'request_id': 'req-dbee296e-272b-44c5-b55c-5bd0b80f425f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:10.555807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9419625d31f2466abd60d4d61cc1fc09', 'request_id': 'req-dbee296e-272b-44c5-b55c-5bd0b80f425f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:10.592516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] The token cache is being invalidate because project 9419625d31f2466abd60d4d61cc1fc09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:10.592816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:10.595512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-dbee296e-272b-44c5-b55c-5bd0b80f425f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:10.598169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1015/2040] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:10 2022] DELETE /identity/v3/projects/9419625d31f2466abd60d4d61cc1fc09 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:10.609453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675064-3c67-4b50-8183-92b5dd7fb52c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:10.609985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675064-3c67-4b50-8183-92b5dd7fb52c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:10.611868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f675064-3c67-4b50-8183-92b5dd7fb52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:10.637559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2f675064-3c67-4b50-8183-92b5dd7fb52c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:10.639281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2f675064-3c67-4b50-8183-92b5dd7fb52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:10.720496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd001-a4ce-4029-91d7-fdd20750c81a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:10.720741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd001-a4ce-4029-91d7-fdd20750c81a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:10.721065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cd001-a4ce-4029-91d7-fdd20750c81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:10.724928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1026/2041] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:10.749040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b89cd001-a4ce-4029-91d7-fdd20750c81a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:10.752555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b89cd001-a4ce-4029-91d7-fdd20750c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:10.772869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1016/2042] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:10.777715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f675064-3c67-4b50-8183-92b5dd7fb52c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:10.790355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f675064-3c67-4b50-8183-92b5dd7fb52c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:10.798342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:10.799351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:10.799736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:10.800111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:10.801166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:10.803506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:10.806093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:10.836053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1027/2043] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:10.840238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd001-a4ce-4029-91d7-fdd20750c81a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:10.851975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cd001-a4ce-4029-91d7-fdd20750c81a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:10.857622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:10.858412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:10.858892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:10.859397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:10.860182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:10.863092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:10.909019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1017/2044] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:10 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:10.913373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:10.927548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fc95e-5002-4645-a841-7f8f409f1950 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:11.036133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:11.036839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:11.037121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:11.037393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:11.038102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:11.040138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:11.089507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1028/2045] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:10 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:11.093810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:11.106518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634c4f4-d3cf-4ada-ba23-461c2edf94ae admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:11.119180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:11.120194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:11.120674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:11.121272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:11.122603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:11.125257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:11.152932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1018/2046] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:11.153333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:11.172291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568b7f4-873d-493b-ac50-8066e64ac78c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:11.191126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d16775-e929-4d9c-9c63-2951984b6797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:11.192091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d16775-e929-4d9c-9c63-2951984b6797 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:11.192624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d16775-e929-4d9c-9c63-2951984b6797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:11.193088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d16775-e929-4d9c-9c63-2951984b6797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:11.194016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d16775-e929-4d9c-9c63-2951984b6797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:11.209761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d16775-e929-4d9c-9c63-2951984b6797 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:11.238377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1029/2047] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:11.239093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:11.274877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece87cc-1e4c-4711-b4d8-25f19eb592c8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:11.305566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:11.311001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:11.311484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:11.312127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] PATH_INFO: `/v3/projects/641a2fa14fe943728c1ccc395b1e2320/users/0e425653d4bf473aac2547e3af708537/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:11.320933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:11.350929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641a2fa14fe943728c1ccc395b1e2320, user_id=0e425653d4bf473aac2547e3af708537, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:11.356381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:11.395036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1019/2048] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:11 2022] PUT /identity/v3/projects/641a2fa14fe943728c1ccc395b1e2320/users/0e425653d4bf473aac2547e3af708537/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:11.406760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4f25-e910-46b6-b5d4-86a224ec69af None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:11.406760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4f25-e910-46b6-b5d4-86a224ec69af None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:11.406760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b4f25-e910-46b6-b5d4-86a224ec69af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:11.471651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c90b4f25-e910-46b6-b5d4-86a224ec69af None None] MFA Rules not processed for user `0e425653d4bf473aac2547e3af708537`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:11.473152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c90b4f25-e910-46b6-b5d4-86a224ec69af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:11.509952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:11.630660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1030/2049] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:11.635633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:11.793815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca64b5-f4cd-4404-9bf5-bfa9754e5db4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:11.801390 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:11.802674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:11.803144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:11.804106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:11.805008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:11.807518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:11.855253 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1020/2050] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:11 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:11.856307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4f25-e910-46b6-b5d4-86a224ec69af None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:11.879369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b4f25-e910-46b6-b5d4-86a224ec69af None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:11.968588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:11.969581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:11.970702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:11.971004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:11.971920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:11.974039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:11.999463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1031/2051] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:11 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:12.003528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:12.014326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c0afc-62e3-450c-a495-35f72b30d691 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:12.021160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:12.022078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:12.022381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:12.022663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:12.023559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:12.025563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:12.042332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1021/2052] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:12.044607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:12.057177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6beb5b1-3ffc-4694-9c39-67a3dfaac510 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:12.062050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:12.062989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:12.063312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:12.063653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] PATH_INFO: `/v3/projects/7ca7ee0c8c0146c5981abf89001c400f/users/60cabc17624640bba329940809bb42c8/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:12.083172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca7ee0c8c0146c5981abf89001c400f, user_id=60cabc17624640bba329940809bb42c8, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:12.086153 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:12.102785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1032/2053] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:12 2022] PUT /identity/v3/projects/7ca7ee0c8c0146c5981abf89001c400f/users/60cabc17624640bba329940809bb42c8/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:12.107534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:12.119085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fcc87-f90e-4d39-809d-d32a981f42de admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:12.189941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46b4ce-f20f-4cc2-b355-1658d5fe538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:12.190682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46b4ce-f20f-4cc2-b355-1658d5fe538e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:12.190971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46b4ce-f20f-4cc2-b355-1658d5fe538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:12.191247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46b4ce-f20f-4cc2-b355-1658d5fe538e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:12.192067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46b4ce-f20f-4cc2-b355-1658d5fe538e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:12.193746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46b4ce-f20f-4cc2-b355-1658d5fe538e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:12.204730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1022/2054] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:12.209191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:12.220497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89d17d-ce56-4764-b389-3853c7d610bb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:12.225444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:12.226376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:12.226660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:12.226939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] PATH_INFO: `/v3/projects/7ca7ee0c8c0146c5981abf89001c400f/users/60cabc17624640bba329940809bb42c8/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:12.229094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca7ee0c8c0146c5981abf89001c400f, user_id=60cabc17624640bba329940809bb42c8, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:12.232208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:12.248272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1033/2055] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:12 2022] PUT /identity/v3/projects/7ca7ee0c8c0146c5981abf89001c400f/users/60cabc17624640bba329940809bb42c8/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:12.260002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a73b-920d-429b-b95a-418be12aa92e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:12.260560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a73b-920d-429b-b95a-418be12aa92e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:12.260560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a73b-920d-429b-b95a-418be12aa92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:12.292776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3e0a73b-920d-429b-b95a-418be12aa92e None None] MFA Rules not processed for user `60cabc17624640bba329940809bb42c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:12.294094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3e0a73b-920d-429b-b95a-418be12aa92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:12.346747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:12.380929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1023/2056] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:12.393179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:12.395374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:12.483422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3653d-7c33-4384-82de-f7319da22212 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:12.487558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:12.489393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:12.489393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:12.489393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:12.499007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:12.500460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:12.511201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1034/2057] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:12.874129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0a73b-920d-429b-b95a-418be12aa92e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:12.886173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0a73b-920d-429b-b95a-418be12aa92e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:12.891409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36e389-f96a-4d9a-a3eb-b859a77e9639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:12.892207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e389-f96a-4d9a-a3eb-b859a77e9639 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:12.892491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e389-f96a-4d9a-a3eb-b859a77e9639 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:12.892763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e389-f96a-4d9a-a3eb-b859a77e9639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:12.894716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba36e389-f96a-4d9a-a3eb-b859a77e9639 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:12.931142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:12.950963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:12.997244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36e389-f96a-4d9a-a3eb-b859a77e9639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:12.998836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36e389-f96a-4d9a-a3eb-b859a77e9639 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:13.023065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1024/2058] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:13.043889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778495ca-0626-42f4-98b0-c863580197ee service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:13.054457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:13.055377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:13.055755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:13.055929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] PATH_INFO: `/v3/users/0e425653d4bf473aac2547e3af708537` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:13.059053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e425653d4bf473aac2547e3af708537)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:13.060997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:13.161659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e425653d4bf473aac2547e3af708537'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.176672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e425653d4bf473aac2547e3af708537'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.191976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e425653d4bf473aac2547e3af708537'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.199731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e425653d4bf473aac2547e3af708537'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.200832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e425653d4bf473aac2547e3af708537'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.213292 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1035/2059] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:12 2022] DELETE /identity/v3/users/0e425653d4bf473aac2547e3af708537 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:13.224361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:13.224689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:13.224973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:13.254684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:13.256173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:13.335905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1025/2060] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:13.346529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:13.348356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:13.450261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f407eb0-7bd7-4fea-9c2c-39c50c65430e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:13.454118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534e60a-5d7d-4cb9-b5f2-6fd9d294fbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:13.454912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e60a-5d7d-4cb9-b5f2-6fd9d294fbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:13.455326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e60a-5d7d-4cb9-b5f2-6fd9d294fbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:13.455693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534e60a-5d7d-4cb9-b5f2-6fd9d294fbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:13.463182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:13.465628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:13.485033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534e60a-5d7d-4cb9-b5f2-6fd9d294fbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:13.492888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534e60a-5d7d-4cb9-b5f2-6fd9d294fbe3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:13.494683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef4dd8-8ad6-4a0a-a2fe-52e46db211ac None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:13.505662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:13.506684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:13.507009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:13.507316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] PATH_INFO: `/v3/users/8848ec125aee413e9ed830f9f1e5fe9c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:13.509337 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8848ec125aee413e9ed830f9f1e5fe9c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:13.513021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:13.516053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1036/2061] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:13.587306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8848ec125aee413e9ed830f9f1e5fe9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.588183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8848ec125aee413e9ed830f9f1e5fe9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.588885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8848ec125aee413e9ed830f9f1e5fe9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.605576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8848ec125aee413e9ed830f9f1e5fe9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.616481 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:13.628403 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8848ec125aee413e9ed830f9f1e5fe9c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:13.643467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1026/2062] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:13 2022] DELETE /identity/v3/users/8848ec125aee413e9ed830f9f1e5fe9c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:13.648770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:13.649193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:13.649599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:13.687246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:13.700110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:13.763250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:13.804490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1037/2063] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:13.878995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:13.881073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:14.021965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396568-b928-4d4b-ac90-d60ce7ae5b9d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:14.027285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:14.028259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:14.036045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:14.044040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:14.068745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:14.070647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:14.088276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1027/2064] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:14.669564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:14.672078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:14.699096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836348b-4456-4a0b-a3a5-7bb6c7eec8a3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:14.709320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:14.710659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:14.711045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:14.711714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] PATH_INFO: `/v3/projects/641a2fa14fe943728c1ccc395b1e2320` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:14.714101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641a2fa14fe943728c1ccc395b1e2320)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:14.716540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:14.807068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641a2fa14fe943728c1ccc395b1e2320', 'request_id': 'req-eecc2859-86ca-4bca-8cf2-92c27792e0c1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:14.823412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641a2fa14fe943728c1ccc395b1e2320', 'request_id': 'req-eecc2859-86ca-4bca-8cf2-92c27792e0c1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:14.834902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641a2fa14fe943728c1ccc395b1e2320', 'request_id': 'req-eecc2859-86ca-4bca-8cf2-92c27792e0c1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:14.867470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] The token cache is being invalidate because project 641a2fa14fe943728c1ccc395b1e2320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:14.867763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:14.868698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:14.870806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1038/2065] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:14 2022] DELETE /identity/v3/projects/641a2fa14fe943728c1ccc395b1e2320 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:14.874895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:14.886113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d374da4-c1d4-472d-bc6f-2f2d6a505bdf service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:15.002799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:15.003711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:15.003997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:15.004468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] PATH_INFO: `/v3/users/60cabc17624640bba329940809bb42c8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:15.005698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60cabc17624640bba329940809bb42c8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:15.007710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:15.089347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60cabc17624640bba329940809bb42c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.090239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60cabc17624640bba329940809bb42c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.091192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60cabc17624640bba329940809bb42c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.119206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60cabc17624640bba329940809bb42c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.143546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60cabc17624640bba329940809bb42c8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.177019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1028/2066] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:14 2022] DELETE /identity/v3/users/60cabc17624640bba329940809bb42c8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:15.286807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:15.288916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:15.339448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc2859-86ca-4bca-8cf2-92c27792e0c1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:15.432990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:15.435441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:15.435871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:15.436195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] PATH_INFO: `/v3/projects/4edb224a061b4eabb828aec9f1cfb98d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:15.437569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edb224a061b4eabb828aec9f1cfb98d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:15.439910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:15.495668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edb224a061b4eabb828aec9f1cfb98d', 'request_id': 'req-2edbaa02-c877-4388-9cc1-50a91f552efe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.504790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edb224a061b4eabb828aec9f1cfb98d', 'request_id': 'req-2edbaa02-c877-4388-9cc1-50a91f552efe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.511131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:15.514621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edb224a061b4eabb828aec9f1cfb98d', 'request_id': 'req-2edbaa02-c877-4388-9cc1-50a91f552efe'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.529766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] The token cache is being invalidate because project 4edb224a061b4eabb828aec9f1cfb98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:15.530089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.530970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.534022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1039/2067] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:15 2022] DELETE /identity/v3/projects/4edb224a061b4eabb828aec9f1cfb98d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:15.538264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:15.539876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:15.553762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86b8c9-0d6b-4ed2-a917-5bd790d8667f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:15.557969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:15.638231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:15.639172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:15.639455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:15.639727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] PATH_INFO: `/v3/users/5cbe7054b60c439287b7b4c44f7b759f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:15.640968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbe7054b60c439287b7b4c44f7b759f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:15.643180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:15.713516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbe7054b60c439287b7b4c44f7b759f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.714196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbe7054b60c439287b7b4c44f7b759f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.715203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbe7054b60c439287b7b4c44f7b759f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.725603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbe7054b60c439287b7b4c44f7b759f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.745541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbe7054b60c439287b7b4c44f7b759f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:15.764516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1029/2068] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:15 2022] DELETE /identity/v3/users/5cbe7054b60c439287b7b4c44f7b759f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:16.096715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.098360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:16.111511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbaa02-c877-4388-9cc1-50a91f552efe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.188576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.189590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.189995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.190407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] PATH_INFO: `/v3/projects/7ca7ee0c8c0146c5981abf89001c400f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.192024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca7ee0c8c0146c5981abf89001c400f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.195487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.238975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.241113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:16.274743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1bed3-04c7-4b1c-96ca-dd488505db03 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.287233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca7ee0c8c0146c5981abf89001c400f', 'request_id': 'req-fdd4ce28-c642-4df3-be31-09ca7740ca9e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.301428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca7ee0c8c0146c5981abf89001c400f', 'request_id': 'req-fdd4ce28-c642-4df3-be31-09ca7740ca9e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.313473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca7ee0c8c0146c5981abf89001c400f', 'request_id': 'req-fdd4ce28-c642-4df3-be31-09ca7740ca9e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.330671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] The token cache is being invalidate because project 7ca7ee0c8c0146c5981abf89001c400f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:16.331174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.332572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fdd4ce28-c642-4df3-be31-09ca7740ca9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.335766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1040/2069] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:16 2022] DELETE /identity/v3/projects/7ca7ee0c8c0146c5981abf89001c400f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:16.350805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9a9af-95e1-4d72-b988-7a7648d29c30 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.351102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9a9af-95e1-4d72-b988-7a7648d29c30 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.351381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9a9af-95e1-4d72-b988-7a7648d29c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.382898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.384024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.384377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.384775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] PATH_INFO: `/v3/projects/1477b575bb674433ae70643f43d48122` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.387222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1477b575bb674433ae70643f43d48122)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.392311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.397733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0ea9a9af-95e1-4d72-b988-7a7648d29c30 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:16.399014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0ea9a9af-95e1-4d72-b988-7a7648d29c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:16.437746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1041/2070] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:16.439974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6540-d938-4655-9f81-72a725fd014a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.440245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6540-d938-4655-9f81-72a725fd014a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.440459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6540-d938-4655-9f81-72a725fd014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.460305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:16.471639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6baa6540-d938-4655-9f81-72a725fd014a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:16.472948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6baa6540-d938-4655-9f81-72a725fd014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:16.490709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1477b575bb674433ae70643f43d48122', 'request_id': 'req-2a69a142-f218-42cb-92a1-45f02a0a1ce5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.501963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1477b575bb674433ae70643f43d48122', 'request_id': 'req-2a69a142-f218-42cb-92a1-45f02a0a1ce5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.512317 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1477b575bb674433ae70643f43d48122', 'request_id': 'req-2a69a142-f218-42cb-92a1-45f02a0a1ce5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.531096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] The token cache is being invalidate because project 1477b575bb674433ae70643f43d48122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:16.531386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.532017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2a69a142-f218-42cb-92a1-45f02a0a1ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:16.533880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1030/2071] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:16 2022] DELETE /identity/v3/projects/1477b575bb674433ae70643f43d48122 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:16.538641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe744-18eb-43ae-8369-5280edec6557 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.538934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe744-18eb-43ae-8369-5280edec6557 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.539215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9fe744-18eb-43ae-8369-5280edec6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.568747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2a9fe744-18eb-43ae-8369-5280edec6557 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:16.570330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1042/2072] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:16.570711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2a9fe744-18eb-43ae-8369-5280edec6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:16.574883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6540-d938-4655-9f81-72a725fd014a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.588049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6540-d938-4655-9f81-72a725fd014a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.589996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1031/2073] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:16.593215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.593894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.594178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.595343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.595343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:16.595604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.597235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.599388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90315739-4f23-4da4-92b9-812b88673eb4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.599767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90315739-4f23-4da4-92b9-812b88673eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.600117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90315739-4f23-4da4-92b9-812b88673eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.608877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:16.613835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1043/2074] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:16.617991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.620232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-90315739-4f23-4da4-92b9-812b88673eb4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:16.621494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90315739-4f23-4da4-92b9-812b88673eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:16.630218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1032/2075] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:16.630647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91b738-a842-435e-904e-1dc3f3d62be9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.634557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90315739-4f23-4da4-92b9-812b88673eb4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.636241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.636972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.637352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.637694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.638492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.640481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.644045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90315739-4f23-4da4-92b9-812b88673eb4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.649206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.649872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.650159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.650462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.651256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:16.651532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.653174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.667152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1033/2076] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:28:16.671036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.674347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1044/2077] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:16.677452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.681339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac27fe-b1bb-47a6-b975-9eee2482c22a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.747430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.748263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.748375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.748591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.749288 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.751478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.763881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d3255-0bc0-481c-b047-12a4752b6fed admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.769980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.771083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.771570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.771926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.772874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.775794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.788339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1034/2078] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:16.792873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.800687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1045/2079] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:16.805305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.816130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea5a75-ecc3-42e7-acd3-f406d3abbe44 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.887862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.888507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.888964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.889134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.889871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.891037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd865cc-1e42-452f-9cc0-f0e2e2d93ad9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.891548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.899875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.900761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.901119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.901456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.902390 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.905001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1046/2080] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:16.907100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.908539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.925816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d9b3-ca69-442d-85f9-c3f86755ac40 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.931492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.932233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.932446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.932708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.933587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.935530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.951384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1047/2081] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:16.951384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.951657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1035/2082] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:16 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:16.952703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:16.961979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:16.964337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28268553-33b6-45de-97ae-95d32adcbd81 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.969331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916dda5b-090c-48b4-b516-517cd1eb535e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:16.970144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.971105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.971400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.971678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.972556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:16.974716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:16.977598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:16.978468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:16.979052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:16.979600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] PATH_INFO: `/v3/projects/fc0268a55a624b0ca4348d8b84f0c5dc/users/813f4bb9822b4443a800f0c35280f1c8/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:16.990989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1048/2083] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:16.995163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.006674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0268a55a624b0ca4348d8b84f0c5dc, user_id=813f4bb9822b4443a800f0c35280f1c8, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.010564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edd134-fc47-4aa1-b5ea-04c8df6e1387 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.011865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.017808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d21e74-b1f2-48d3-86f6-55bea4f12b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.019462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21e74-b1f2-48d3-86f6-55bea4f12b14 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.019793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21e74-b1f2-48d3-86f6-55bea4f12b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.020784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d21e74-b1f2-48d3-86f6-55bea4f12b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.021815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d21e74-b1f2-48d3-86f6-55bea4f12b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.024496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d21e74-b1f2-48d3-86f6-55bea4f12b14 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.038161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1036/2084] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:16 2022] PUT /identity/v3/projects/fc0268a55a624b0ca4348d8b84f0c5dc/users/813f4bb9822b4443a800f0c35280f1c8/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:17.048204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.048701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1049/2085] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:17.050904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.051944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.053303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.110338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] MFA Rules not processed for user `813f4bb9822b4443a800f0c35280f1c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:17.113492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:17.150274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:17.206154 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e73a85-604b-41c1-a864-76ec90149cd2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.213668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c852a64-c5a6-46b9-acfb-d81930fa2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.215142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c852a64-c5a6-46b9-acfb-d81930fa2a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.215982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c852a64-c5a6-46b9-acfb-d81930fa2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.216266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c852a64-c5a6-46b9-acfb-d81930fa2a81 admin admin] PATH_INFO: `/v3/projects/44d9df2130c645ceb916f441931ddfa2/users/4c73f139b9c446139bfe655017d62bb0/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.234001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1050/2086] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:17.245655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.246515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c852a64-c5a6-46b9-acfb-d81930fa2a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44d9df2130c645ceb916f441931ddfa2, user_id=4c73f139b9c446139bfe655017d62bb0, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.247805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:17.250059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c852a64-c5a6-46b9-acfb-d81930fa2a81 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.267333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1037/2087] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:17 2022] PUT /identity/v3/projects/44d9df2130c645ceb916f441931ddfa2/users/4c73f139b9c446139bfe655017d62bb0/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:17.277781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a472d1b-f5a8-41a5-acc1-33b571bb3ae8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.278278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a472d1b-f5a8-41a5-acc1-33b571bb3ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.278581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a472d1b-f5a8-41a5-acc1-33b571bb3ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.308959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3a472d1b-f5a8-41a5-acc1-33b571bb3ae8 None None] MFA Rules not processed for user `4c73f139b9c446139bfe655017d62bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:17.310389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a472d1b-f5a8-41a5-acc1-33b571bb3ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:17.311100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144d775-459d-4236-a66e-30e922ce8108 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.370873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.371532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.371816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.372154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.387189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1038/2088] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:17.393324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a472d1b-f5a8-41a5-acc1-33b571bb3ae8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.462614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:17.463430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.465455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.479433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1051/2089] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:28:17.482889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a472d1b-f5a8-41a5-acc1-33b571bb3ae8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.501574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.501984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.503189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.503895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.504241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.505258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.507299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.533381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f70228-6101-46b1-a611-ede4a8d9b074 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.541581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.542566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.542846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.543125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] PATH_INFO: `/v3/users/813f4bb9822b4443a800f0c35280f1c8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.544411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=813f4bb9822b4443a800f0c35280f1c8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.546744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.567599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1039/2090] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:17 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:17.568735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.615434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:17.658643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813f4bb9822b4443a800f0c35280f1c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:17.672677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813f4bb9822b4443a800f0c35280f1c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:17.686119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4c497-75cf-4b61-b368-f09e084a2240 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.692402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.693192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.693545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.693772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813f4bb9822b4443a800f0c35280f1c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:17.693942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.694784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.700565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.701904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813f4bb9822b4443a800f0c35280f1c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:17.702538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-458556aa-a96b-414f-98a0-5199889aa6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813f4bb9822b4443a800f0c35280f1c8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:17.712174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1052/2091] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:17 2022] DELETE /identity/v3/users/813f4bb9822b4443a800f0c35280f1c8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:17.716886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.719335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.719626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.746323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1040/2092] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:17 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:17.748332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.749464 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:17.750036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:17.751183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:17.763675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f69950-2f2a-43e7-b371-ad59741c0ae3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.817807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1053/2093] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:17.828787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.830562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:17.840689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.841475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.841830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.842209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.843029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.845052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.858756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1041/2094] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:17.863007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.875255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83747d3-5d2e-47c6-a770-a86863238127 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.881802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.883015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.883368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.889654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] PATH_INFO: `/v3/projects/80f69645ea234e648c0bee7de5956de1/users/d7a5dda018794ee3b838a04856f8ed77/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.900290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f69645ea234e648c0bee7de5956de1, user_id=d7a5dda018794ee3b838a04856f8ed77, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.902881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb17e7d-7305-4ba0-9d6a-a9bd6ad55391 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.903215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.906630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.907466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.907987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.908633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.918866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1042/2095] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:17 2022] PUT /identity/v3/projects/80f69645ea234e648c0bee7de5956de1/users/d7a5dda018794ee3b838a04856f8ed77/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:17.923104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:17.923261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.924584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:17.934883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1054/2096] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:28:17.967460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:17.990184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b5a86-bbaa-4f31-a7e9-2813f394bb3e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:17.995226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d468a14-0ddd-4738-bfca-4d5317d42317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:17.995948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468a14-0ddd-4738-bfca-4d5317d42317 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:17.996225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468a14-0ddd-4738-bfca-4d5317d42317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:17.996583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468a14-0ddd-4738-bfca-4d5317d42317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:17.997389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d468a14-0ddd-4738-bfca-4d5317d42317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:17.999118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d468a14-0ddd-4738-bfca-4d5317d42317 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.011035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1043/2097] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:18.015279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.026257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c57923-c821-46fd-bb01-5d80095063bb service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.031468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.032579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.032907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.033071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] PATH_INFO: `/v3/projects/80f69645ea234e648c0bee7de5956de1/users/d7a5dda018794ee3b838a04856f8ed77/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.035231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f69645ea234e648c0bee7de5956de1, user_id=d7a5dda018794ee3b838a04856f8ed77, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.038214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.049801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1055/2098] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:18 2022] PUT /identity/v3/projects/80f69645ea234e648c0bee7de5956de1/users/d7a5dda018794ee3b838a04856f8ed77/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:18.059913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.060225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.060483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.088433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] MFA Rules not processed for user `d7a5dda018794ee3b838a04856f8ed77`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:18.089691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.166252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1044/2099] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:18.178646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.180569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.224449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:18.244117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.245474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.285175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aea6c-15c2-4dd9-9196-07f898978747 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.290435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.291396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.292004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.292004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.310548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.312704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.320805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68c4ab-8d2e-49b5-86f6-b00410491fba None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.324019 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1056/2100] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:18.324958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.326642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.327105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.328045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.328256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.328537 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] PATH_INFO: `/v3/projects/fc0268a55a624b0ca4348d8b84f0c5dc` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.329804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0268a55a624b0ca4348d8b84f0c5dc)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.331768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.347469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c0de2-238b-4a64-a59f-6019e5908abe service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.355082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.356336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.357188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.357747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] PATH_INFO: `/v3/users/8412e7e9e5524892947d4d30469bb546` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.361416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8412e7e9e5524892947d4d30469bb546)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.364579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.397111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0268a55a624b0ca4348d8b84f0c5dc', 'request_id': 'req-195cc85e-2055-4709-859a-e2828fcdd776'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.406374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0268a55a624b0ca4348d8b84f0c5dc', 'request_id': 'req-195cc85e-2055-4709-859a-e2828fcdd776'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.414585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0268a55a624b0ca4348d8b84f0c5dc', 'request_id': 'req-195cc85e-2055-4709-859a-e2828fcdd776'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.419705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:18.433723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8412e7e9e5524892947d4d30469bb546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.436626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] The token cache is being invalidate because project fc0268a55a624b0ca4348d8b84f0c5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:18.436993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.438031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-195cc85e-2055-4709-859a-e2828fcdd776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.439648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1045/2101] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:18 2022] DELETE /identity/v3/projects/fc0268a55a624b0ca4348d8b84f0c5dc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:18.448085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8412e7e9e5524892947d4d30469bb546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.448916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028d5b-409c-4ea3-ab63-840bce265686 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.449240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028d5b-409c-4ea3-ab63-840bce265686 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.449547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3028d5b-409c-4ea3-ab63-840bce265686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.462130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8412e7e9e5524892947d4d30469bb546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.468752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d3028d5b-409c-4ea3-ab63-840bce265686 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:18.470010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8412e7e9e5524892947d4d30469bb546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.470198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d3028d5b-409c-4ea3-ab63-840bce265686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.470762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8412e7e9e5524892947d4d30469bb546'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:18.477042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1057/2102] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:18 2022] DELETE /identity/v3/users/8412e7e9e5524892947d4d30469bb546 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:18.478068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.479509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.535011 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1046/2103] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:18.536277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37caa25-7c80-4af0-ba13-8593238c759c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.536571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37caa25-7c80-4af0-ba13-8593238c759c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.536852 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37caa25-7c80-4af0-ba13-8593238c759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.546749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412dce9-6705-433e-8a64-502941814564 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.551481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.552270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.552553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.553268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.555453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.558810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c37caa25-7c80-4af0-ba13-8593238c759c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:18.560032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c37caa25-7c80-4af0-ba13-8593238c759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.619880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.621359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.623959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1047/2104] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:18.625270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf421-efe9-4569-b3eb-a8dc3ca65786 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.625562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf421-efe9-4569-b3eb-a8dc3ca65786 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.625839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bf421-efe9-4569-b3eb-a8dc3ca65786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.637030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1058/2105] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:18.637741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.639089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.644689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-303bf421-efe9-4569-b3eb-a8dc3ca65786 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:18.644831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:18.645911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-303bf421-efe9-4569-b3eb-a8dc3ca65786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:18.655314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1048/2106] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:18.659928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bf421-efe9-4569-b3eb-a8dc3ca65786 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.672642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bf421-efe9-4569-b3eb-a8dc3ca65786 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.677725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.678427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.678853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.679158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.679901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:18.680211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.682025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.695867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1049/2107] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:18.700274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.711954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fee026-a7f8-4778-8bde-e9ac488f54d9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.712085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8dd61-f91a-4b59-83f7-c1e83b12c46e service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.716491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.716916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.717150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.717432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.717569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.717708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.717856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.718146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.718909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.720883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.728032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.729462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.740508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1059/2108] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:18.752886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1050/2109] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:18 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:18.757047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.770563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feff07-8e02-4edf-b3c4-9e652869f476 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.862478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.863512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.863888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.864362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.865306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.867872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.899779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1060/2110] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:18 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:18.903517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.916377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91813-16a2-45c4-b1a6-f7ed0dd001f0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.924227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.925091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.925559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.925947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.931485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.933531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:18.947611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1051/2111] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:18.952051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:18.968176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fffd12-5c04-46ae-98cc-0581b399f115 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:18.975246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7ca3e-48e8-4f21-9288-37ccb3845880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:18.976035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ca3e-48e8-4f21-9288-37ccb3845880 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:18.976394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ca3e-48e8-4f21-9288-37ccb3845880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:18.977233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7ca3e-48e8-4f21-9288-37ccb3845880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:18.978145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7ca3e-48e8-4f21-9288-37ccb3845880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:18.980118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7ca3e-48e8-4f21-9288-37ccb3845880 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:19.003763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1061/2112] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:19.008695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:19.022614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a814e-a1d4-46ab-8c9d-690d1868b37c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:19.028507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:19.029427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:19.029763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:19.030029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] PATH_INFO: `/v3/projects/86ae7517c1e4462ba70a83438354d897/users/4e73fe3d022847fdbbefbdd2399a9e24/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:19.067002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ae7517c1e4462ba70a83438354d897, user_id=4e73fe3d022847fdbbefbdd2399a9e24, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:19.072883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:19.113804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1052/2113] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:19 2022] PUT /identity/v3/projects/86ae7517c1e4462ba70a83438354d897/users/4e73fe3d022847fdbbefbdd2399a9e24/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:19.124399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:19.124798 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:19.125174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:19.165757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] MFA Rules not processed for user `4e73fe3d022847fdbbefbdd2399a9e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:19.167117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:19.245380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1062/2114] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:19.254440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:19.274584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:19.317482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b983-5749-407f-9cc4-cb345a517dd9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:19.322441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:19.323118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:19.323382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:19.323654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:19.332838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:19.334342 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:19.346359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1053/2115] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:19.371895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:19.373898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:19.391141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:19.474230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d0f02-c1fa-4347-9c6e-1c52c240fbdd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:19.480215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:19.481112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:19.481391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:19.481663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] PATH_INFO: `/v3/projects/1b9c7c116b3e4c10a44fbe40ffbc200e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:19.483618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9c7c116b3e4c10a44fbe40ffbc200e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:19.486830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:19.551490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9c7c116b3e4c10a44fbe40ffbc200e', 'request_id': 'req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.561755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9c7c116b3e4c10a44fbe40ffbc200e', 'request_id': 'req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.572050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9c7c116b3e4c10a44fbe40ffbc200e', 'request_id': 'req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.587886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] The token cache is being invalidate because project 1b9c7c116b3e4c10a44fbe40ffbc200e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:19.588430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.589726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.592261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1063/2116] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:19 2022] DELETE /identity/v3/projects/1b9c7c116b3e4c10a44fbe40ffbc200e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:19.596487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:19.608911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d70a-b0d1-4b4d-937f-5ed2019a3790 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:19.700802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:19.701806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:19.702156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:19.702543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] PATH_INFO: `/v3/users/55c418acb1004fba80576dbe5fcae7b4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:19.703818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c418acb1004fba80576dbe5fcae7b4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:19.706137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:19.779574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c418acb1004fba80576dbe5fcae7b4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.780319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c418acb1004fba80576dbe5fcae7b4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.781290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c418acb1004fba80576dbe5fcae7b4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.791471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c418acb1004fba80576dbe5fcae7b4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.805758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c22581db-968d-4a74-ae32-19c427a2e40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c418acb1004fba80576dbe5fcae7b4'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:19.825543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1054/2117] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:19 2022] DELETE /identity/v3/users/55c418acb1004fba80576dbe5fcae7b4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:20.111603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:20.118231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:20.140088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8812d0-3ecc-4fbf-ac8d-833ad5419b4b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:20.249261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:20.250383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.250740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.251501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] PATH_INFO: `/v3/projects/acd4f9a2d23e4fe1966dfdf4534455fb` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.253592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd4f9a2d23e4fe1966dfdf4534455fb)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:20.255820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:20.319029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:20.324124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd4f9a2d23e4fe1966dfdf4534455fb', 'request_id': 'req-393377e6-5b22-4dad-abce-c8a10ef13f18'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:20.334682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd4f9a2d23e4fe1966dfdf4534455fb', 'request_id': 'req-393377e6-5b22-4dad-abce-c8a10ef13f18'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:20.341638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd4f9a2d23e4fe1966dfdf4534455fb', 'request_id': 'req-393377e6-5b22-4dad-abce-c8a10ef13f18'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:20.356495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] The token cache is being invalidate because project acd4f9a2d23e4fe1966dfdf4534455fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:20.357148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:20.357817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-393377e6-5b22-4dad-abce-c8a10ef13f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:20.359501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1064/2118] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:20 2022] DELETE /identity/v3/projects/acd4f9a2d23e4fe1966dfdf4534455fb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:20.367092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2a1e-d259-42bd-8365-216cd847856d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.368003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2a1e-d259-42bd-8365-216cd847856d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.368518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d2a1e-d259-42bd-8365-216cd847856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.395907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-249d2a1e-d259-42bd-8365-216cd847856d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:20.397474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-249d2a1e-d259-42bd-8365-216cd847856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:20.460899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:20.523322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1055/2119] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:20.525500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b49f-f180-4a5f-bc34-23d292038854 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.525613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b49f-f180-4a5f-bc34-23d292038854 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.525892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b49f-f180-4a5f-bc34-23d292038854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.565928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8ac9b49f-f180-4a5f-bc34-23d292038854 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:20.567563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ac9b49f-f180-4a5f-bc34-23d292038854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:20.594007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1065/2120] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:20.599254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d2a1e-d259-42bd-8365-216cd847856d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:20.612060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d2a1e-d259-42bd-8365-216cd847856d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:20.618531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:20.619731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.620025 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.620284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.621866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:20.622336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:20.624223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:20.643790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b49f-f180-4a5f-bc34-23d292038854 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:20.649847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1056/2121] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:20.654887 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b49f-f180-4a5f-bc34-23d292038854 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:20.669557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:20.670138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.670479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.670729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.671431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:20.673493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:20.717584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1066/2122] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:20 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:20.719372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:20.736449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71107db4-54d4-4729-82f0-f94149539107 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:20.869020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:20.869885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.870022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.870266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.870998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:20.872920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:20.918700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1057/2123] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:20 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:20.922679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:20.934076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae17869-1af5-480d-96d4-7eccb23821a4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:20.940539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:20.941431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.941946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.942427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.944078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:20.946278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:20.965521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1067/2124] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:20.969553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:20.980509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e892b-a8aa-48f7-abd8-62040a9af829 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:20.987123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449f2ab-39e7-47c9-a722-f62a37650ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:20.988072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449f2ab-39e7-47c9-a722-f62a37650ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:20.988699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449f2ab-39e7-47c9-a722-f62a37650ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:20.988699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449f2ab-39e7-47c9-a722-f62a37650ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:20.989369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449f2ab-39e7-47c9-a722-f62a37650ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:20.991036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449f2ab-39e7-47c9-a722-f62a37650ff2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:21.003832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1058/2125] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:21.008047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:21.018835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206397f7-7c97-468c-8acf-5052e22d18e6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:21.025850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:21.026791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:21.027076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:21.027358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] PATH_INFO: `/v3/projects/5bb15f91501d43a383fa1d5c71765955/users/22ebc761e1594df8abfa1a366604828d/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:21.046005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb15f91501d43a383fa1d5c71765955, user_id=22ebc761e1594df8abfa1a366604828d, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:21.049307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:21.064679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1068/2126] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:21 2022] PUT /identity/v3/projects/5bb15f91501d43a383fa1d5c71765955/users/22ebc761e1594df8abfa1a366604828d/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:21.076441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ba5d-01d0-456c-8240-679473221163 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:21.076441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ba5d-01d0-456c-8240-679473221163 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:21.076638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875ba5d-01d0-456c-8240-679473221163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:21.108216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4875ba5d-01d0-456c-8240-679473221163 None None] MFA Rules not processed for user `22ebc761e1594df8abfa1a366604828d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:21.109511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4875ba5d-01d0-456c-8240-679473221163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:21.286301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1059/2127] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:21.303097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:21.304594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:21.445643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e9682-1991-4db9-b05f-8272def3edd3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:21.449893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c02be-dc44-4c90-b36d-55e758dd82d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:21.451421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c02be-dc44-4c90-b36d-55e758dd82d3 service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:21.451538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c02be-dc44-4c90-b36d-55e758dd82d3 service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:21.451988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c02be-dc44-4c90-b36d-55e758dd82d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:21.462846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c02be-dc44-4c90-b36d-55e758dd82d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:21.465608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c02be-dc44-4c90-b36d-55e758dd82d3 service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:21.477249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1069/2128] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:23.832705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb41c-d720-4eda-a11e-0dc1bf10aae0 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:23.833343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb41c-d720-4eda-a11e-0dc1bf10aae0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:23.833343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bb41c-d720-4eda-a11e-0dc1bf10aae0 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:23.834847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1060/2129] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:28:23.848997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:23.850078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:23.850453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:23.883588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:23.884945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:23.902406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb41c-d720-4eda-a11e-0dc1bf10aae0 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:23.904191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c8bb41c-d720-4eda-a11e-0dc1bf10aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:23.958878 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:23.961127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:23.983992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1070/2130] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:28:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:23.996460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:23.998074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:24.010300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bb41c-d720-4eda-a11e-0dc1bf10aae0 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.010300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.010300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.010300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.010736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] PATH_INFO: `/v3/users/0ffbfc994b03410faf1a124ac7d4cc72` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.011267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f50c97-41be-4422-86bc-c85634a78c3a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.012174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffbfc994b03410faf1a124ac7d4cc72)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.014236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.016469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.017211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.017496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.017889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.027154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.028849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.041528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1071/2131] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:28:24.077756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffbfc994b03410faf1a124ac7d4cc72'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.078775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffbfc994b03410faf1a124ac7d4cc72'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.079546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffbfc994b03410faf1a124ac7d4cc72'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.086693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffbfc994b03410faf1a124ac7d4cc72'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.098261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1857ca92-2c95-4fc1-a8ba-f38344cae4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffbfc994b03410faf1a124ac7d4cc72'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.112116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1061/2132] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:23 2022] DELETE /identity/v3/users/0ffbfc994b03410faf1a124ac7d4cc72 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:24.296444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.310133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c409b-19ec-4462-b42b-adb65ceebdc6 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.379990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.380881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.381202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.381435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] PATH_INFO: `/v3/projects/53b09ab3c6fc459c99223298d4284f28` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.383330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b09ab3c6fc459c99223298d4284f28)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.385323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.439587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b09ab3c6fc459c99223298d4284f28', 'request_id': 'req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.451697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b09ab3c6fc459c99223298d4284f28', 'request_id': 'req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.461195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b09ab3c6fc459c99223298d4284f28', 'request_id': 'req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.473975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] The token cache is being invalidate because project 53b09ab3c6fc459c99223298d4284f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:24.474251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.475006 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.480138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1072/2133] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:24 2022] DELETE /identity/v3/projects/53b09ab3c6fc459c99223298d4284f28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:24.485667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9909-ff55-43aa-a348-ea56ca7f0b90 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.486065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9909-ff55-43aa-a348-ea56ca7f0b90 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.486560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b9909-ff55-43aa-a348-ea56ca7f0b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.500162 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.502114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:24.508494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c46b9909-ff55-43aa-a348-ea56ca7f0b90 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:24.510710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c46b9909-ff55-43aa-a348-ea56ca7f0b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:24.584536 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceea57c-d32b-410c-afd9-e84cd5aa65a7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.590211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.591392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.591677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.591999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] PATH_INFO: `/v3/users/4c73f139b9c446139bfe655017d62bb0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.593342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c73f139b9c446139bfe655017d62bb0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.595726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.613706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:24.615563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1062/2134] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:24.627371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3408ef-344a-4b30-b258-06910fc609ae None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.627657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3408ef-344a-4b30-b258-06910fc609ae None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.627938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3408ef-344a-4b30-b258-06910fc609ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.654585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cc3408ef-344a-4b30-b258-06910fc609ae None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:24.656185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc3408ef-344a-4b30-b258-06910fc609ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:24.665665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1063/2135] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:24.669741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3408ef-344a-4b30-b258-06910fc609ae None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.679209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c73f139b9c446139bfe655017d62bb0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.679961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3408ef-344a-4b30-b258-06910fc609ae None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.690122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.690837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.691116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.691417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.691815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c73f139b9c446139bfe655017d62bb0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.692125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:24.692423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.694264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.716895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1064/2136] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:24.717084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c73f139b9c446139bfe655017d62bb0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.717898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.722651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c73f139b9c446139bfe655017d62bb0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.723484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caa9857a-c363-4106-9c53-2cd3938127ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c73f139b9c446139bfe655017d62bb0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:24.728658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef269-ab8d-4578-82b5-2aa07b22359c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.729613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1073/2137] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:24 2022] DELETE /identity/v3/users/4c73f139b9c446139bfe655017d62bb0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:24.734077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.734399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.734681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.752633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:24.753930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:24.759768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:24.795140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.795851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.796135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.796411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.797148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.799147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.820947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1074/2138] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:24.828589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1065/2139] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:24 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:24.829965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.830747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.831370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:24.832338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:24.843008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509643d-baff-406a-8cf6-985c961e87dc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.891685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccc4ca-d905-4bbe-8c71-e7088d8f3e09 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.895915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.896745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.897026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.897302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.901384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.902061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.902369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.902643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.903323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.905232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.906613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.908473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.918349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1066/2140] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:28:24.927131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1075/2141] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:24 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:24.931734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.944220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242cca1-ec4d-4569-9cbf-2287bbf56936 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.950719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.951414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.951707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.952049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.952823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.954605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:24.966330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1067/2142] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:24.970192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:24.980573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce276c1-2d0d-4d25-bd86-a6e95e7a79ab admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:24.985655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf4684-7492-4e09-a399-324a2f037144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:24.986548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4684-7492-4e09-a399-324a2f037144 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:24.986840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4684-7492-4e09-a399-324a2f037144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:24.987146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf4684-7492-4e09-a399-324a2f037144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:24.987855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf4684-7492-4e09-a399-324a2f037144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:24.989484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf4684-7492-4e09-a399-324a2f037144 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:25.001614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1076/2143] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:28:25.005909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:25.016841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2b427-8469-42b0-8d20-697dae3b636b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:25.022170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:25.024254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:25.024254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:25.024254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] PATH_INFO: `/v3/projects/071b126de410461db7821d71e13d0a49/users/ce36343f44a64fa3b0fb36587dd77f7c/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:25.045725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071b126de410461db7821d71e13d0a49, user_id=ce36343f44a64fa3b0fb36587dd77f7c, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:25.048605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:25.067061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1068/2144] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:25 2022] PUT /identity/v3/projects/071b126de410461db7821d71e13d0a49/users/ce36343f44a64fa3b0fb36587dd77f7c/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:25.081132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:25.081431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:25.081713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:25.091336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:25.120962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] MFA Rules not processed for user `ce36343f44a64fa3b0fb36587dd77f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:25.122353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:25.218870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:25.221040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:25.237369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1077/2145] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:25.247818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:25.250034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:25.339278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b927f1-072b-41d6-b419-1f559bb55315 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:25.346075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:25.347536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:25.347825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:25.348107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] PATH_INFO: `/v3/projects/44d9df2130c645ceb916f441931ddfa2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:25.349323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44d9df2130c645ceb916f441931ddfa2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:25.351343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:25.363086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abcf22-bf3e-48d8-8a92-a7e0e5aaae1c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:25.370327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:25.371229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:25.371648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:25.371927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:25.381603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:25.383158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:25.395157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1078/2146] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:28:25.397517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:25.417463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d9df2130c645ceb916f441931ddfa2', 'request_id': 'req-466dc05d-536a-4c45-b17b-5f568c610248'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.425428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d9df2130c645ceb916f441931ddfa2', 'request_id': 'req-466dc05d-536a-4c45-b17b-5f568c610248'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.432947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d9df2130c645ceb916f441931ddfa2', 'request_id': 'req-466dc05d-536a-4c45-b17b-5f568c610248'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.458251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] The token cache is being invalidate because project 44d9df2130c645ceb916f441931ddfa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:25.458480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.459424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.465425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1069/2147] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:25 2022] DELETE /identity/v3/projects/44d9df2130c645ceb916f441931ddfa2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:25.467097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:25.478066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf3d82-ed73-4599-bec9-500faabe05f7 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:25.547731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:25.548788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:25.549134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:25.549440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] PATH_INFO: `/v3/users/d7a5dda018794ee3b838a04856f8ed77` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:25.550777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a5dda018794ee3b838a04856f8ed77)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:25.552754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:25.578527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:25.605812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a5dda018794ee3b838a04856f8ed77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.615932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a5dda018794ee3b838a04856f8ed77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.634385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a5dda018794ee3b838a04856f8ed77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.642505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a5dda018794ee3b838a04856f8ed77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.642988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-423b2e78-26d0-4f38-a3ca-d731f3a52673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a5dda018794ee3b838a04856f8ed77'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:25.650384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1079/2148] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:25 2022] DELETE /identity/v3/users/d7a5dda018794ee3b838a04856f8ed77 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:26.056916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.059635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:26.075943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466dc05d-536a-4c45-b17b-5f568c610248 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.140294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.141183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.141460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.141916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] PATH_INFO: `/v3/projects/80f69645ea234e648c0bee7de5956de1` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.143264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f69645ea234e648c0bee7de5956de1)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.145207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.195384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f69645ea234e648c0bee7de5956de1', 'request_id': 'req-264271d7-0def-4370-bd86-5876aae6aedb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:26.200969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f69645ea234e648c0bee7de5956de1', 'request_id': 'req-264271d7-0def-4370-bd86-5876aae6aedb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:26.207429 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f69645ea234e648c0bee7de5956de1', 'request_id': 'req-264271d7-0def-4370-bd86-5876aae6aedb'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:26.224084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] The token cache is being invalidate because project 80f69645ea234e648c0bee7de5956de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:26.224621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:26.225813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-264271d7-0def-4370-bd86-5876aae6aedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:26.228835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1070/2149] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:26 2022] DELETE /identity/v3/projects/80f69645ea234e648c0bee7de5956de1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:26.234411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99750-8a43-489a-9439-4f25e073af91 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.234924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99750-8a43-489a-9439-4f25e073af91 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.235031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb99750-8a43-489a-9439-4f25e073af91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.256007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-feb99750-8a43-489a-9439-4f25e073af91 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:26.257563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-feb99750-8a43-489a-9439-4f25e073af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:26.326112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1080/2150] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:26.335331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feeafc-69f8-43e8-b28e-e0d20ee04d3d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.335650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feeafc-69f8-43e8-b28e-e0d20ee04d3d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.335958 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feeafc-69f8-43e8-b28e-e0d20ee04d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.355803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-40feeafc-69f8-43e8-b28e-e0d20ee04d3d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:26.357388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-40feeafc-69f8-43e8-b28e-e0d20ee04d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:26.365933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1071/2151] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:26.370394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99750-8a43-489a-9439-4f25e073af91 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.382001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb99750-8a43-489a-9439-4f25e073af91 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.387313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.387980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.388287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.388561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.389301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:26.389603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.391270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.403884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1081/2152] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:28:26.409108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40feeafc-69f8-43e8-b28e-e0d20ee04d3d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.419850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40feeafc-69f8-43e8-b28e-e0d20ee04d3d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.428943 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.429742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.430033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.430369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.431071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.432990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.464497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1072/2153] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:26 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:26.470316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.481416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f13e68-5003-44aa-8969-30c73c508b95 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.546177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.546891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.547477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.547477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.548418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.550499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.570611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1082/2154] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:26 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:26.580575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.593044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f82e0-06df-4807-8e54-b084ed896f53 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.598038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.598756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.599037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.599313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.600103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.601727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.613361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1073/2155] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:26.617588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.628226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd77f3f-c251-4841-a254-296e21d5271a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.633522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06367eaf-232e-47da-8eee-23b2b99ffeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.634236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367eaf-232e-47da-8eee-23b2b99ffeef admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.634715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367eaf-232e-47da-8eee-23b2b99ffeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.634852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367eaf-232e-47da-8eee-23b2b99ffeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.635657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06367eaf-232e-47da-8eee-23b2b99ffeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.637448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06367eaf-232e-47da-8eee-23b2b99ffeef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.649086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1083/2156] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:26.654712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.664816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea39203-0363-4392-b6c3-2b02b96b6472 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.669569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.670487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.670770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.671045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] PATH_INFO: `/v3/projects/3dd7a0c1dece4ce3834cd57e22e347a6/users/5bcb1bb8462249e1a2d8acf0f7e08b27/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.673414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:26.700233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd7a0c1dece4ce3834cd57e22e347a6, user_id=5bcb1bb8462249e1a2d8acf0f7e08b27, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.703269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.724405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1074/2157] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:26 2022] PUT /identity/v3/projects/3dd7a0c1dece4ce3834cd57e22e347a6/users/5bcb1bb8462249e1a2d8acf0f7e08b27/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:26.726266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09b84-a634-4c77-9c2f-ba0e88b2d440 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.726725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09b84-a634-4c77-9c2f-ba0e88b2d440 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.726967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09b84-a634-4c77-9c2f-ba0e88b2d440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.735228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:26.749306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e4f09b84-a634-4c77-9c2f-ba0e88b2d440 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:26.751926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e4f09b84-a634-4c77-9c2f-ba0e88b2d440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:26.814763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1084/2158] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:26.824721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:26.826703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:26.889279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb937a-523d-4b52-8ef9-ab51777fc538 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:26.893934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:26.894632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:26.894916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:26.895178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:26.904530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:26.905977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:26.916397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1075/2159] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:27.660901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:27.661420 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:27.661573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:27.688214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] MFA Rules not processed for user `5bcb1bb8462249e1a2d8acf0f7e08b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:27.689655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:27.762817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1085/2160] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:27.805101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:27.806981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:27.869273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d208443-f2f4-4ef4-867c-0fe4a7e6887a service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:27.872893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:27.873615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:27.873897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:27.874183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:27.883466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:27.884910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:27.901734 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1076/2161] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:28.071432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:28.073154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:28.085890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d255-f739-4634-8b21-8a4474b80375 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:28.089919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78486aef-7497-4f45-b70e-be478bacffe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:28.090608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486aef-7497-4f45-b70e-be478bacffe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:28.090896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486aef-7497-4f45-b70e-be478bacffe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:28.091171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486aef-7497-4f45-b70e-be478bacffe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:28.092937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78486aef-7497-4f45-b70e-be478bacffe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:28.170936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78486aef-7497-4f45-b70e-be478bacffe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:28.171338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78486aef-7497-4f45-b70e-be478bacffe2 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:28.191965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1086/2162] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:28 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:28.339777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:28.341261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:28.363260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bfafc-da6c-4842-8616-830629afcd86 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:28.373275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:28.374261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:28.374781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:28.375057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] PATH_INFO: `/v3/users/ce36343f44a64fa3b0fb36587dd77f7c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:28.376384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce36343f44a64fa3b0fb36587dd77f7c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:28.378408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:28.438166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce36343f44a64fa3b0fb36587dd77f7c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:28.438960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce36343f44a64fa3b0fb36587dd77f7c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:28.439567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce36343f44a64fa3b0fb36587dd77f7c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:28.447888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce36343f44a64fa3b0fb36587dd77f7c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:28.461306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce36343f44a64fa3b0fb36587dd77f7c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:28.472550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:28.477984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1077/2163] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:28 2022] DELETE /identity/v3/users/ce36343f44a64fa3b0fb36587dd77f7c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:28.483365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:28.483836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:28.484199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:28.502955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:28.504305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:28.534273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:28.582696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1087/2164] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:28.592766 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:28.594367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:28.662721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396dc1f-4dff-4fc0-8f7a-8953397cb6cf admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:28.666410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc098775-91ce-404a-b796-921647e664b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:28.667067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc098775-91ce-404a-b796-921647e664b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:28.667351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc098775-91ce-404a-b796-921647e664b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:28.667707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc098775-91ce-404a-b796-921647e664b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:28.680565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc098775-91ce-404a-b796-921647e664b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:28.682252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc098775-91ce-404a-b796-921647e664b8 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:28.703909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1078/2165] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:28.986926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:28.988492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:29.001142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b9ea7-5a55-4c30-9ebe-1a20927f6c05 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.007034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.007988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.008268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.008579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] PATH_INFO: `/v3/projects/071b126de410461db7821d71e13d0a49` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.009896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071b126de410461db7821d71e13d0a49)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.012046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.060801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071b126de410461db7821d71e13d0a49', 'request_id': 'req-a6107c35-f168-4a0b-96d2-1c1b66c08083'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:29.068917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071b126de410461db7821d71e13d0a49', 'request_id': 'req-a6107c35-f168-4a0b-96d2-1c1b66c08083'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:29.075002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071b126de410461db7821d71e13d0a49', 'request_id': 'req-a6107c35-f168-4a0b-96d2-1c1b66c08083'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:29.086723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] The token cache is being invalidate because project 071b126de410461db7821d71e13d0a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:29.087011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:29.087663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6107c35-f168-4a0b-96d2-1c1b66c08083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:29.089274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1088/2166] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:28 2022] DELETE /identity/v3/projects/071b126de410461db7821d71e13d0a49 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:29.094303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5042e94-8281-4920-94dc-5f93e5fae83d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.094872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5042e94-8281-4920-94dc-5f93e5fae83d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.095083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5042e94-8281-4920-94dc-5f93e5fae83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.114180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c5042e94-8281-4920-94dc-5f93e5fae83d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:29.115350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5042e94-8281-4920-94dc-5f93e5fae83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:29.176189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1079/2167] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:29.184167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275cc13-c861-4cd3-a1b1-e99afdd1c10a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.184457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275cc13-c861-4cd3-a1b1-e99afdd1c10a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.184777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275cc13-c861-4cd3-a1b1-e99afdd1c10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.205460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d275cc13-c861-4cd3-a1b1-e99afdd1c10a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:29.206723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d275cc13-c861-4cd3-a1b1-e99afdd1c10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:29.216074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1089/2168] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:29.220733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5042e94-8281-4920-94dc-5f93e5fae83d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.231217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5042e94-8281-4920-94dc-5f93e5fae83d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.236963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.237673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.237950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.238250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.239058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:29.239362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.240985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.253394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1080/2169] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:29.258223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275cc13-c861-4cd3-a1b1-e99afdd1c10a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.271491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275cc13-c861-4cd3-a1b1-e99afdd1c10a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.277435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ece539-feeb-4d4b-9209-6f36044bd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.278134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece539-feeb-4d4b-9209-6f36044bd7ca admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.278475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece539-feeb-4d4b-9209-6f36044bd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.278752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ece539-feeb-4d4b-9209-6f36044bd7ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.279452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ece539-feeb-4d4b-9209-6f36044bd7ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.281387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ece539-feeb-4d4b-9209-6f36044bd7ca admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.320141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1090/2170] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:29.321680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.335470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a848b-4ed1-46cd-828b-8104904fecc1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.367024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2b27-2033-4662-847e-22a148cadaa6 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.367291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2b27-2033-4662-847e-22a148cadaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.367528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2b27-2033-4662-847e-22a148cadaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.398409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7a8b2b27-2033-4662-847e-22a148cadaa6 None None] MFA Rules not processed for user `5bcb1bb8462249e1a2d8acf0f7e08b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:29.399697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7a8b2b27-2033-4662-847e-22a148cadaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:29.444000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.444000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.444000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.444000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.444383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.446754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.480980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1081/2171] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:29.485117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1091/2172] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:29.486656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.499820 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984eab93-0a71-4024-a808-d7efe5b1cf1d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.504573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.505259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.505558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.505793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.506596 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.508440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.522451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1082/2173] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:29.527092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b2b27-2033-4662-847e-22a148cadaa6 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.541187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b2b27-2033-4662-847e-22a148cadaa6 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.548634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c251-8af2-4ff1-89ee-b65a1a9fda0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.549396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c251-8af2-4ff1-89ee-b65a1a9fda0b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.549961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c251-8af2-4ff1-89ee-b65a1a9fda0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.550363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c251-8af2-4ff1-89ee-b65a1a9fda0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.551164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c251-8af2-4ff1-89ee-b65a1a9fda0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.553154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c251-8af2-4ff1-89ee-b65a1a9fda0b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.568176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1092/2174] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:29.569533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.585493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bd7db-bfaa-456b-9f08-ed00b189f463 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.593480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.594129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.594129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.595676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] PATH_INFO: `/v3/projects/c992cbdc5dfd40cb81336647d02dcd83/users/4073055d8f99481988def54e48ec4f75/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.600178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:29.618551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c992cbdc5dfd40cb81336647d02dcd83, user_id=4073055d8f99481988def54e48ec4f75, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.621250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.640266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1083/2175] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:29 2022] PUT /identity/v3/projects/c992cbdc5dfd40cb81336647d02dcd83/users/4073055d8f99481988def54e48ec4f75/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:29.651953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca72de3-3a1f-4163-aea9-d898e9097ba4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.652235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca72de3-3a1f-4163-aea9-d898e9097ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.652514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca72de3-3a1f-4163-aea9-d898e9097ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.700721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fca72de3-3a1f-4163-aea9-d898e9097ba4 None None] MFA Rules not processed for user `4073055d8f99481988def54e48ec4f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:29.701972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fca72de3-3a1f-4163-aea9-d898e9097ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:29.707656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:29.788686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1093/2176] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:29.792840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.909230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec798c4-7a82-49e6-8458-5a6c96cd6d3a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:29.925648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:29.926424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:29.926708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:29.927016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:29.927799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:29.929726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:29.969695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1084/2177] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:29.971540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca72de3-3a1f-4163-aea9-d898e9097ba4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:29.984318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca72de3-3a1f-4163-aea9-d898e9097ba4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:30.056840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:30.057739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.058092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.058612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.059555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:30.061949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:30.084264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1094/2178] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:29 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:30.088213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:30.099129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c94f2-2333-4df0-908e-eb31632cd063 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:30.105482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:30.106375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.107046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.107326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.108094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:30.109733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:30.122068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1085/2179] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:30.127185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:30.137912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fbc1b-277f-450f-9ae4-dcccac348836 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:30.143217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:30.144125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.144412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.144690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] PATH_INFO: `/v3/projects/cb176da1b372449ebb51b580f209e28a/users/f189fae1143c44f9a9f1873007ead253/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.162614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb176da1b372449ebb51b580f209e28a, user_id=f189fae1143c44f9a9f1873007ead253, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:30.165494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:30.180726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1095/2180] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:30 2022] PUT /identity/v3/projects/cb176da1b372449ebb51b580f209e28a/users/f189fae1143c44f9a9f1873007ead253/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:30.184835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:30.195460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc8f2a-8896-4a88-9963-f3a25dbfcb19 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:30.256461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad12f8-c96a-4f33-8021-dfeb34dd96f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:30.257448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad12f8-c96a-4f33-8021-dfeb34dd96f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.257766 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad12f8-c96a-4f33-8021-dfeb34dd96f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.258050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad12f8-c96a-4f33-8021-dfeb34dd96f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.258841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad12f8-c96a-4f33-8021-dfeb34dd96f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:30.261196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad12f8-c96a-4f33-8021-dfeb34dd96f4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:30.275063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1086/2181] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:30.276471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:30.287305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c2595-eeb2-4abc-b9e3-29e8a3a49bbe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:30.292631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:30.293906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.294041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.295988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] PATH_INFO: `/v3/projects/cb176da1b372449ebb51b580f209e28a/users/f189fae1143c44f9a9f1873007ead253/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.296914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb176da1b372449ebb51b580f209e28a, user_id=f189fae1143c44f9a9f1873007ead253, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:30.300573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:30.314334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1096/2182] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:30 2022] PUT /identity/v3/projects/cb176da1b372449ebb51b580f209e28a/users/f189fae1143c44f9a9f1873007ead253/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:30.322819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464e468-ed92-4c63-814b-d19525188302 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.323108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464e468-ed92-4c63-814b-d19525188302 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.323423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464e468-ed92-4c63-814b-d19525188302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.355185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b464e468-ed92-4c63-814b-d19525188302 None None] MFA Rules not processed for user `f189fae1143c44f9a9f1873007ead253`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:30.356475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b464e468-ed92-4c63-814b-d19525188302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:30.406675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:30.435940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1087/2183] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:30.448451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:30.450451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:30.513799 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3a672-1f1d-4002-b3ff-221ef1cba21f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:30.518434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6126590-3950-4c11-b295-2d8eb75139d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:30.519228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126590-3950-4c11-b295-2d8eb75139d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.519627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126590-3950-4c11-b295-2d8eb75139d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.519945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6126590-3950-4c11-b295-2d8eb75139d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.530846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6126590-3950-4c11-b295-2d8eb75139d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:30.532739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6126590-3950-4c11-b295-2d8eb75139d9 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:30.544037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1097/2184] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:30.618304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464e468-ed92-4c63-814b-d19525188302 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:30.630041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464e468-ed92-4c63-814b-d19525188302 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:30.635102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:30.635841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:30.636128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:30.636400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:30.694733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:30.696090 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:30.705560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1088/2185] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:28:40.538864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:40.708760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=37 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:48.826139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a8ee8-ffb6-4d73-885d-e8db1fb01f46 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:48.828027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a8ee8-ffb6-4d73-885d-e8db1fb01f46 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:48.828507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2a8ee8-ffb6-4d73-885d-e8db1fb01f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:48.854061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9f2a8ee8-ffb6-4d73-885d-e8db1fb01f46 None None] MFA Rules not processed for user `5bcb1bb8462249e1a2d8acf0f7e08b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:48.857299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9f2a8ee8-ffb6-4d73-885d-e8db1fb01f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:48.934276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1098/2186] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:51.494630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:51.496334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:51.615287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33312bd1-e7ee-4760-ba55-30ee9c1fdc26 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:51.620245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:51.621176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:51.621456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:51.621727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] PATH_INFO: `/v3/users/fca528490bf54177a931f84c8e76dc70` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:51.623533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca528490bf54177a931f84c8e76dc70)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:51.625516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:51.677440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca528490bf54177a931f84c8e76dc70'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:51.678103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca528490bf54177a931f84c8e76dc70'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:51.678872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca528490bf54177a931f84c8e76dc70'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:51.687993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca528490bf54177a931f84c8e76dc70'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:51.700983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca528490bf54177a931f84c8e76dc70'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:51.715232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1089/2187] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:51 2022] DELETE /identity/v3/users/fca528490bf54177a931f84c8e76dc70 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:51.899237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a8ee8-ffb6-4d73-885d-e8db1fb01f46 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:51.916553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2a8ee8-ffb6-4d73-885d-e8db1fb01f46 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:52.004434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:52.005724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:52.006154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:52.006604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] PATH_INFO: `/v3/projects/33e6c34c333147e6a703cd2e9e1ceb09` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:52.008151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e6c34c333147e6a703cd2e9e1ceb09)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:52.010279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:52.060879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e6c34c333147e6a703cd2e9e1ceb09', 'request_id': 'req-1547e827-640c-418a-96bc-999f93374655'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.071791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e6c34c333147e6a703cd2e9e1ceb09', 'request_id': 'req-1547e827-640c-418a-96bc-999f93374655'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.077797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e6c34c333147e6a703cd2e9e1ceb09', 'request_id': 'req-1547e827-640c-418a-96bc-999f93374655'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.092216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] The token cache is being invalidate because project 33e6c34c333147e6a703cd2e9e1ceb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:52.092600 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.093300 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.095013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1099/2188] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:51 2022] DELETE /identity/v3/projects/33e6c34c333147e6a703cd2e9e1ceb09 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:52.099258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:52.109700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:52.115918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705b84-2a83-4392-aed6-09355fc33977 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:52.175065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:52.175967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:52.176252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:52.176526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] PATH_INFO: `/v3/users/80c62f46d0224814925b7e52779c3d32` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:52.177720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c62f46d0224814925b7e52779c3d32)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:52.179683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:52.201849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:52.229008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c62f46d0224814925b7e52779c3d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.229666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c62f46d0224814925b7e52779c3d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.230272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c62f46d0224814925b7e52779c3d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.238784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c62f46d0224814925b7e52779c3d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.253774 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-5a619c32-eaf4-4bdb-9245-f0301f150753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c62f46d0224814925b7e52779c3d32'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:52.268661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1090/2189] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:52 2022] DELETE /identity/v3/users/80c62f46d0224814925b7e52779c3d32 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:28:52.904532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:52.907094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:52.929836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547e827-640c-418a-96bc-999f93374655 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:52.977783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:53.010706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.012482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.012875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.013327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] PATH_INFO: `/v3/projects/3fcdcb2755f449dbba61e584d272abdf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.014870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcdcb2755f449dbba61e584d272abdf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.016917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.076374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcdcb2755f449dbba61e584d272abdf', 'request_id': 'req-a6f3054c-91f5-43c4-986a-453daff3155a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:53.085728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcdcb2755f449dbba61e584d272abdf', 'request_id': 'req-a6f3054c-91f5-43c4-986a-453daff3155a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:53.091734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcdcb2755f449dbba61e584d272abdf', 'request_id': 'req-a6f3054c-91f5-43c4-986a-453daff3155a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:53.104012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] The token cache is being invalidate because project 3fcdcb2755f449dbba61e584d272abdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:53.104210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:53.105378 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a6f3054c-91f5-43c4-986a-453daff3155a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:53.107410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1100/2190] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:52 2022] DELETE /identity/v3/projects/3fcdcb2755f449dbba61e584d272abdf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:53.112873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fbbf2-28b1-4e5b-a76d-7c42af6b313b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.113400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fbbf2-28b1-4e5b-a76d-7c42af6b313b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.113881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fbbf2-28b1-4e5b-a76d-7c42af6b313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.133277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-632fbbf2-28b1-4e5b-a76d-7c42af6b313b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:53.134762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-632fbbf2-28b1-4e5b-a76d-7c42af6b313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:53.212174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1091/2191] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:53.220523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c2c3-7690-4b09-a69c-d2a4747c6af2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.221411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c2c3-7690-4b09-a69c-d2a4747c6af2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.221700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8c2c3-7690-4b09-a69c-d2a4747c6af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.244313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e8d8c2c3-7690-4b09-a69c-d2a4747c6af2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:53.246246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e8d8c2c3-7690-4b09-a69c-d2a4747c6af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:53.259806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1101/2192] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:53.264907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fbbf2-28b1-4e5b-a76d-7c42af6b313b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:53.275029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fbbf2-28b1-4e5b-a76d-7c42af6b313b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:53.279958 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.280631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.280909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.281227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.282299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:53.282664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.284322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.298280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1092/2193] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:28:53.302831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8c2c3-7690-4b09-a69c-d2a4747c6af2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:53.312726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8c2c3-7690-4b09-a69c-d2a4747c6af2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:53.317403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.318075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.318386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.318679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.319372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.321267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.345998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1102/2194] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:53 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:53.350642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:53.363252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e5dcf-9904-4f15-a3ab-b47f0cd28ed9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:53.426444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.427173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.427461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.427760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.428549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.430532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.450619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1093/2195] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:53 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:53.455049 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:53.466228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a77ab2-93ab-4968-9230-913792f2426c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:53.471246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.471920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.472297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.472548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.473326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.475055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.498601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1103/2196] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:53.503341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:53.514484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3d22b-bd62-41d5-a69d-b2f8a343433d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:53.519533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814a55f-43a1-46e8-8b16-db1b8e234762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.520223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814a55f-43a1-46e8-8b16-db1b8e234762 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.520508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814a55f-43a1-46e8-8b16-db1b8e234762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.520787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814a55f-43a1-46e8-8b16-db1b8e234762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.521528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814a55f-43a1-46e8-8b16-db1b8e234762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.523177 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814a55f-43a1-46e8-8b16-db1b8e234762 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.534498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1094/2197] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:53.538841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:53.549512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992f76f-b106-4447-a8a7-75419b539ffe admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:53.554226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.555149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.555430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.555697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] PATH_INFO: `/v3/projects/55cfc54d15b14028b63effac04a91d6c/users/d84867c06f474b18b5148cba6982dd58/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.572142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cfc54d15b14028b63effac04a91d6c, user_id=d84867c06f474b18b5148cba6982dd58, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.574877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.594560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1104/2198] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:53 2022] PUT /identity/v3/projects/55cfc54d15b14028b63effac04a91d6c/users/d84867c06f474b18b5148cba6982dd58/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:53.604513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.604806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.605089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.612540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:53.634412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] MFA Rules not processed for user `d84867c06f474b18b5148cba6982dd58`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:53.635642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:53.703722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1095/2199] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:53.715466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:53.717532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:53.784222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134d19-d485-4f8a-842b-be63fb7de859 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:53.788232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8310d-a3ff-47fe-ba5f-e2babfa8760e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:53.788888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8310d-a3ff-47fe-ba5f-e2babfa8760e service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:53.789173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8310d-a3ff-47fe-ba5f-e2babfa8760e service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:53.789449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8310d-a3ff-47fe-ba5f-e2babfa8760e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:53.798713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8310d-a3ff-47fe-ba5f-e2babfa8760e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:53.800156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8310d-a3ff-47fe-ba5f-e2babfa8760e service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:53.809538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1105/2200] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:28:55.751989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:55.753610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:55.822261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bcf9a-198a-4b7d-99c3-0c48afb1d70b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:55.826968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:55.827885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:55.828164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:55.828435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] PATH_INFO: `/v3/users/22ebc761e1594df8abfa1a366604828d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:55.829888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ebc761e1594df8abfa1a366604828d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:55.831876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:55.883720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ebc761e1594df8abfa1a366604828d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:55.884484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ebc761e1594df8abfa1a366604828d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:55.885216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ebc761e1594df8abfa1a366604828d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:55.893056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ebc761e1594df8abfa1a366604828d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:55.905967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ebc761e1594df8abfa1a366604828d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:55.924138 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1096/2201] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:28:55 2022] DELETE /identity/v3/users/22ebc761e1594df8abfa1a366604828d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:55.928652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:55.929119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:55.929488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:55.936562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:55.948745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:55.950502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:56.013038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1106/2202] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:56.023591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:56.025023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:56.042189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:56.091450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e6df13-e8d3-4158-9353-967cda98ac14 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:56.116115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208e943-4ab0-41e3-b075-bf0b300d03a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:56.116842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e943-4ab0-41e3-b075-bf0b300d03a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:56.117085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e943-4ab0-41e3-b075-bf0b300d03a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:56.117365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e943-4ab0-41e3-b075-bf0b300d03a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:56.128165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e943-4ab0-41e3-b075-bf0b300d03a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:56.129609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208e943-4ab0-41e3-b075-bf0b300d03a2 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:56.147507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1097/2203] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:28:56.584372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:56.590457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:56.633427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718f386-dc4f-41a5-b088-74f741ce3b17 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:56.641996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:56.642932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:56.643214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:56.643492 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] PATH_INFO: `/v3/projects/5bb15f91501d43a383fa1d5c71765955` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:56.644693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb15f91501d43a383fa1d5c71765955)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:56.647901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:56.722720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb15f91501d43a383fa1d5c71765955', 'request_id': 'req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:56.732035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb15f91501d43a383fa1d5c71765955', 'request_id': 'req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:56.741077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb15f91501d43a383fa1d5c71765955', 'request_id': 'req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:56.768038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] The token cache is being invalidate because project 5bb15f91501d43a383fa1d5c71765955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:28:56.768318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:56.774686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d96abf8a-fdd6-4a04-8bf8-b1bc3b01925a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:28:56.776547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1107/2204] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:28:56 2022] DELETE /identity/v3/projects/5bb15f91501d43a383fa1d5c71765955 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:56.781984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540b55-d80f-4c50-a2d1-c0867666ee2b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:56.782543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540b55-d80f-4c50-a2d1-c0867666ee2b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:56.782635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9540b55-d80f-4c50-a2d1-c0867666ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:56.818758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c9540b55-d80f-4c50-a2d1-c0867666ee2b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:56.824372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c9540b55-d80f-4c50-a2d1-c0867666ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:56.913433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1098/2205] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:56.921978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977dbd9-46ea-41e5-b6b8-25d63afcbc29 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:56.922270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977dbd9-46ea-41e5-b6b8-25d63afcbc29 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:56.923217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977dbd9-46ea-41e5-b6b8-25d63afcbc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:56.941530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f977dbd9-46ea-41e5-b6b8-25d63afcbc29 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:56.946148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f977dbd9-46ea-41e5-b6b8-25d63afcbc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:56.958801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1108/2206] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:28:56.960226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540b55-d80f-4c50-a2d1-c0867666ee2b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:56.971343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9540b55-d80f-4c50-a2d1-c0867666ee2b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:56.977093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:56.977984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:56.978335 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:56.978635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:56.979650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:28:56.980164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:56.982113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:56.997457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1099/2207] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:28:57.002377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977dbd9-46ea-41e5-b6b8-25d63afcbc29 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:57.012148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977dbd9-46ea-41e5-b6b8-25d63afcbc29 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:57.017414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:57.018080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:57.018715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:57.019146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:57.020013 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:57.022062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:57.050325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1109/2208] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:28:57 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:28:57.053387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:57.065563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e2112-c10c-4490-9352-f04e55f56c80 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:57.130823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:57.131506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:57.131786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:57.132060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:57.132755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:57.134814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:57.158209 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1100/2209] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:28:57 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:28:57.162256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:57.172558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646ea97-9c6a-4288-bf6a-d5e78d0d3319 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:57.177483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:57.178277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:57.178605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:57.178940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:57.179874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:57.181574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:57.193815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1110/2210] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:57.197788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:57.210073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4a832-e2c7-48b2-9b84-9b4f25d4e7bd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:57.216074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b34fea-a2b5-4492-9969-1c9924eb3615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:57.216753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34fea-a2b5-4492-9969-1c9924eb3615 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:57.217038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34fea-a2b5-4492-9969-1c9924eb3615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:57.218051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b34fea-a2b5-4492-9969-1c9924eb3615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:57.218691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b34fea-a2b5-4492-9969-1c9924eb3615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:57.220316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b34fea-a2b5-4492-9969-1c9924eb3615 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:57.234022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1101/2211] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:28:57.238503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:57.252025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccec91-55e4-4fb1-b264-41a648a36729 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:57.257866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:57.258797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:57.259082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:57.259362 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] PATH_INFO: `/v3/projects/c34aec5d9efe4ab8bbf5ec110c61163a/users/a25711f5a38c48db8aa6b817a231951f/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:57.275504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34aec5d9efe4ab8bbf5ec110c61163a, user_id=a25711f5a38c48db8aa6b817a231951f, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:57.278430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:57.293753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1111/2212] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:28:57 2022] PUT /identity/v3/projects/c34aec5d9efe4ab8bbf5ec110c61163a/users/a25711f5a38c48db8aa6b817a231951f/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:28:57.306451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:57.306782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:57.307061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:57.340755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] MFA Rules not processed for user `a25711f5a38c48db8aa6b817a231951f`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:28:57.342196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:57.354678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:57.418711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1102/2213] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:28:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:28:57.431497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:28:57.433444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:28:57.466558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:28:57.501369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26416ab2-3b93-4c2d-b859-fcc9fcd88648 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:28:57.505148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ade935-a8ee-491f-9dda-f18ac42dd9ed service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:28:57.505840 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade935-a8ee-491f-9dda-f18ac42dd9ed service glance] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:28:57.506124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade935-a8ee-491f-9dda-f18ac42dd9ed service glance] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:28:57.506437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade935-a8ee-491f-9dda-f18ac42dd9ed service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:28:57.516920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade935-a8ee-491f-9dda-f18ac42dd9ed service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:28:57.518508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade935-a8ee-491f-9dda-f18ac42dd9ed service glance] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:28:57.531070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1112/2214] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:28:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:01.318273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:01.321953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:01.412861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4b9d7-bd4d-4845-92d2-41f0410b1c39 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:01.418677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:01.419486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:01.419753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:01.420020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] PATH_INFO: `/v3/users/4073055d8f99481988def54e48ec4f75` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:01.421426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4073055d8f99481988def54e48ec4f75)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:01.423754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:01.482862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4073055d8f99481988def54e48ec4f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:01.483843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4073055d8f99481988def54e48ec4f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:01.484615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4073055d8f99481988def54e48ec4f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:01.493193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4073055d8f99481988def54e48ec4f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:01.507846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4073055d8f99481988def54e48ec4f75'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:01.524677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1103/2215] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:01 2022] DELETE /identity/v3/users/4073055d8f99481988def54e48ec4f75 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:01.529214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:01.529720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:01.529811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:01.556180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:01.556180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:01.655641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1113/2216] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:01.666812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:01.668752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:01.733302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:01.759743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b056166-7957-4445-9dba-bf58e1642cc1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:01.763499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:01.764159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:01.764441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:01.764715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:01.774082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:01.775555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:01.785600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1104/2217] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:29:02.084243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:02.085800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:02.098300 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18444f4-2b63-4d25-bee4-3955d0c213fd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:02.103100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:02.103983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:02.104262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:02.104531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] PATH_INFO: `/v3/projects/c992cbdc5dfd40cb81336647d02dcd83` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:02.105859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c992cbdc5dfd40cb81336647d02dcd83)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:02.108097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:02.160476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c992cbdc5dfd40cb81336647d02dcd83', 'request_id': 'req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.169613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c992cbdc5dfd40cb81336647d02dcd83', 'request_id': 'req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.176984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c992cbdc5dfd40cb81336647d02dcd83', 'request_id': 'req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.190235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] The token cache is being invalidate because project c992cbdc5dfd40cb81336647d02dcd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:02.190552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.191288 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.193312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1114/2218] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:02 2022] DELETE /identity/v3/projects/c992cbdc5dfd40cb81336647d02dcd83 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:02.197260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:02.208866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc5676-c90f-4db6-9a31-6efb5dad509d service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:02.272709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:02.273609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:02.273919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:02.274195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] PATH_INFO: `/v3/users/f189fae1143c44f9a9f1873007ead253` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:02.275519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f189fae1143c44f9a9f1873007ead253)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:02.277467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:02.323660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f189fae1143c44f9a9f1873007ead253'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.324393 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f189fae1143c44f9a9f1873007ead253'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.325111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f189fae1143c44f9a9f1873007ead253'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.332395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f189fae1143c44f9a9f1873007ead253'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.343855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6a4f4ad8-d0c4-4776-904c-b974e707a7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f189fae1143c44f9a9f1873007ead253'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.359101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1105/2219] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:02 2022] DELETE /identity/v3/users/f189fae1143c44f9a9f1873007ead253 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:02.731977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:02.733603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:02.749435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c3c8-f3c8-454a-8f8c-b2f475dfba9b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:02.804199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:02.816141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:02.817192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:02.817505 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:02.817779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] PATH_INFO: `/v3/projects/cb176da1b372449ebb51b580f209e28a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:02.819346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb176da1b372449ebb51b580f209e28a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:02.821743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:02.873920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb176da1b372449ebb51b580f209e28a', 'request_id': 'req-74b58c43-18b3-483c-9d00-ca43ce5a01e0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.883674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb176da1b372449ebb51b580f209e28a', 'request_id': 'req-74b58c43-18b3-483c-9d00-ca43ce5a01e0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.890171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb176da1b372449ebb51b580f209e28a', 'request_id': 'req-74b58c43-18b3-483c-9d00-ca43ce5a01e0'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.901881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] The token cache is being invalidate because project cb176da1b372449ebb51b580f209e28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:02.902172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.902900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-74b58c43-18b3-483c-9d00-ca43ce5a01e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:02.904956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1115/2220] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:02 2022] DELETE /identity/v3/projects/cb176da1b372449ebb51b580f209e28a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:02.910469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a85a-de71-4c09-bbb6-6011fa78e68c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:02.910619 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a85a-de71-4c09-bbb6-6011fa78e68c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:02.910854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01a85a-de71-4c09-bbb6-6011fa78e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:02.929858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-eb01a85a-de71-4c09-bbb6-6011fa78e68c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:02.931134 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-eb01a85a-de71-4c09-bbb6-6011fa78e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:02.985121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:03.000809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1106/2221] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:03.009956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c113-0c84-4387-9e38-0b646fdf8bb0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.010220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c113-0c84-4387-9e38-0b646fdf8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.010530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138c113-0c84-4387-9e38-0b646fdf8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.029168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a138c113-0c84-4387-9e38-0b646fdf8bb0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:03.030438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a138c113-0c84-4387-9e38-0b646fdf8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:03.038803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1116/2222] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:03.042984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a85a-de71-4c09-bbb6-6011fa78e68c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.052948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01a85a-de71-4c09-bbb6-6011fa78e68c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.058607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.059267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.059548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.059826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.060562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:03.060885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.062626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.077076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1107/2223] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:03.079444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138c113-0c84-4387-9e38-0b646fdf8bb0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.091001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138c113-0c84-4387-9e38-0b646fdf8bb0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.096893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.097574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.097857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.098134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.099098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.101295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.131078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1117/2224] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:03 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:03.135389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.145894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b6878-c297-4800-b5a3-925e542474ea admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.213346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.214044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.214531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.214805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.215618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.217563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.243272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1108/2225] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:03 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:03.244570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.256841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90782ac9-e02e-442c-a037-34e71fbabe7b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.262960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.263636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.263916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.264185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.264918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.266529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.278345 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1118/2226] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:03.281744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.291919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4404114-08ce-4264-8fe5-c1c36b64c1e4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.297102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17758bc-78a7-4e68-ba8c-8ab1e596f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.297951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17758bc-78a7-4e68-ba8c-8ab1e596f2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.298402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17758bc-78a7-4e68-ba8c-8ab1e596f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.298794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17758bc-78a7-4e68-ba8c-8ab1e596f2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.299676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17758bc-78a7-4e68-ba8c-8ab1e596f2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.301351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17758bc-78a7-4e68-ba8c-8ab1e596f2fe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.313008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1109/2227] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:03.317727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.328384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65be431-5161-4a21-82a5-c0ad17e58f21 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.334178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.335104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.335393 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.335667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] PATH_INFO: `/v3/projects/8a747a3426eb4562a66b0b5d067ac0b5/users/82b27dbdbfeb464798b86e5ef9245a5e/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.351651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a747a3426eb4562a66b0b5d067ac0b5, user_id=82b27dbdbfeb464798b86e5ef9245a5e, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.358012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.375159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1119/2228] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:03 2022] PUT /identity/v3/projects/8a747a3426eb4562a66b0b5d067ac0b5/users/82b27dbdbfeb464798b86e5ef9245a5e/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:03.387128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ac67-c30f-485c-adb6-5a3c5e59563c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.388564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ac67-c30f-485c-adb6-5a3c5e59563c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.389122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22ac67-c30f-485c-adb6-5a3c5e59563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.419805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5f22ac67-c30f-485c-adb6-5a3c5e59563c None None] MFA Rules not processed for user `82b27dbdbfeb464798b86e5ef9245a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:03.422692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5f22ac67-c30f-485c-adb6-5a3c5e59563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:03.495729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1110/2229] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:03.500456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.565467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364f708-639f-4700-b2b8-45035307b806 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.570871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.571566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.571877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.572152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.572844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.574808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.607011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1120/2230] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:03 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:03.611333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ac67-c30f-485c-adb6-5a3c5e59563c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.622314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22ac67-c30f-485c-adb6-5a3c5e59563c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.671120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:03.684582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.685273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.685587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.685868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.686610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.688627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.715880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1111/2231] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:03 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:03.720008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.725466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:03.730855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e06c4-5db6-41d0-a83f-a3c482e94053 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.737673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.739552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.740372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.741168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.742159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.743973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.756830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1121/2232] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:03.761812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.773697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc2a84-4151-4f0e-96e2-73f15ed80bef admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.782470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.782470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.782470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.782470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] PATH_INFO: `/v3/projects/5d38a25b72b440efb41d1adf48580769/users/03e18fcd02584830b87d593247448e6e/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.796509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d38a25b72b440efb41d1adf48580769, user_id=03e18fcd02584830b87d593247448e6e, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.799712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.820161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1112/2233] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:03 2022] PUT /identity/v3/projects/5d38a25b72b440efb41d1adf48580769/users/03e18fcd02584830b87d593247448e6e/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:03.826575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.839958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ee000-2ba7-43b2-9f4d-d829c26470fa admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.905780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6f01a-ca97-40ad-9655-4083b8862e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.906498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6f01a-ca97-40ad-9655-4083b8862e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.906782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6f01a-ca97-40ad-9655-4083b8862e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.907067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6f01a-ca97-40ad-9655-4083b8862e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.907829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6f01a-ca97-40ad-9655-4083b8862e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.909562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6f01a-ca97-40ad-9655-4083b8862e0f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.920510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1122/2234] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:03.924928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:03.935767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a264-b36b-4610-8fd0-103c15b2bb13 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:03.941406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:03.942579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.943017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.943402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] PATH_INFO: `/v3/projects/5d38a25b72b440efb41d1adf48580769/users/03e18fcd02584830b87d593247448e6e/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:03.945648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d38a25b72b440efb41d1adf48580769, user_id=03e18fcd02584830b87d593247448e6e, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:03.948644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:03.960747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1113/2235] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:03 2022] PUT /identity/v3/projects/5d38a25b72b440efb41d1adf48580769/users/03e18fcd02584830b87d593247448e6e/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:03.972121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814047-9f9d-4df3-af6c-44f382616c46 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:03.972121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814047-9f9d-4df3-af6c-44f382616c46 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:03.972121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814047-9f9d-4df3-af6c-44f382616c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:04.005820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9a814047-9f9d-4df3-af6c-44f382616c46 None None] MFA Rules not processed for user `03e18fcd02584830b87d593247448e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:04.007293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9a814047-9f9d-4df3-af6c-44f382616c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:04.095486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1123/2236] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:04.147077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:04.149506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:04.234898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e7e8-4c33-4185-9627-e9a02b48b8a5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:04.239855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:04.240527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:04.240811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:04.241474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:04.254474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:04.256050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:04.272660 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1114/2237] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:04.393742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814047-9f9d-4df3-af6c-44f382616c46 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:04.403550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814047-9f9d-4df3-af6c-44f382616c46 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:04.407772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1eb23-79d9-4802-945a-06088d4d683b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:04.408416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1eb23-79d9-4802-945a-06088d4d683b service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:04.408702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1eb23-79d9-4802-945a-06088d4d683b service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:04.408969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1eb23-79d9-4802-945a-06088d4d683b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:04.474562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1eb23-79d9-4802-945a-06088d4d683b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:04.476145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1eb23-79d9-4802-945a-06088d4d683b service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:04.487270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1124/2238] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:10.299073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:10.307899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:10.460457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56fed8-aa8e-4fd5-a3b8-e41aa49d280f service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:10.478165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:10.481716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:10.482429 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:10.485858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] PATH_INFO: `/v3/users/d84867c06f474b18b5148cba6982dd58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:10.488272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84867c06f474b18b5148cba6982dd58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:10.495473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:10.609735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:10.614091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84867c06f474b18b5148cba6982dd58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:10.615151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84867c06f474b18b5148cba6982dd58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:10.622848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84867c06f474b18b5148cba6982dd58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:10.636577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84867c06f474b18b5148cba6982dd58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:10.664372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84867c06f474b18b5148cba6982dd58'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:10.717963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1115/2239] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:10 2022] DELETE /identity/v3/users/d84867c06f474b18b5148cba6982dd58 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:10.725578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:10.726389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:10.726841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:10.761121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:10.766923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:10.792389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:10.912250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1125/2240] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:10.925521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:10.928595 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.023866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2237b1-7441-43a1-b16c-3141c629055a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:11.028145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e4d6c-b118-4206-bcda-314ee4499fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:11.028901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4d6c-b118-4206-bcda-314ee4499fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.029079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4d6c-b118-4206-bcda-314ee4499fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.029349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4d6c-b118-4206-bcda-314ee4499fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.044011 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e4d6c-b118-4206-bcda-314ee4499fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:11.045911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e4d6c-b118-4206-bcda-314ee4499fb3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:11.058521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1116/2241] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:11.399058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:11.400772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.425781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc2ce4-150b-4a81-9cd2-3fd31f7da60c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:11.438946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:11.439859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.440349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.440629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] PATH_INFO: `/v3/projects/55cfc54d15b14028b63effac04a91d6c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.441869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cfc54d15b14028b63effac04a91d6c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:11.443949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:11.502992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cfc54d15b14028b63effac04a91d6c', 'request_id': 'req-eb47ec5c-0a8c-4110-ae45-c14906b13094'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.512123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cfc54d15b14028b63effac04a91d6c', 'request_id': 'req-eb47ec5c-0a8c-4110-ae45-c14906b13094'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.518697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cfc54d15b14028b63effac04a91d6c', 'request_id': 'req-eb47ec5c-0a8c-4110-ae45-c14906b13094'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.530976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] The token cache is being invalidate because project 55cfc54d15b14028b63effac04a91d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:11.531271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.532156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.533768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1126/2242] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:11 2022] DELETE /identity/v3/projects/55cfc54d15b14028b63effac04a91d6c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:11.538951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9c01-9c3f-4e31-aa70-2c41825bbb4f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.539402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9c01-9c3f-4e31-aa70-2c41825bbb4f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.539491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9c01-9c3f-4e31-aa70-2c41825bbb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.557626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b20a9c01-9c3f-4e31-aa70-2c41825bbb4f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:11.558849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b20a9c01-9c3f-4e31-aa70-2c41825bbb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.574191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:11.575821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.621829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1117/2243] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:11.630889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6880ed-5758-4dc3-a10f-3c132c9f41c2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.631556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6880ed-5758-4dc3-a10f-3c132c9f41c2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.631806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6880ed-5758-4dc3-a10f-3c132c9f41c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.646943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47ec5c-0a8c-4110-ae45-c14906b13094 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:11.651667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:11.652412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8f6880ed-5758-4dc3-a10f-3c132c9f41c2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:11.652589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.652874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.653149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] PATH_INFO: `/v3/users/4e73fe3d022847fdbbefbdd2399a9e24` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.653661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8f6880ed-5758-4dc3-a10f-3c132c9f41c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.654416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e73fe3d022847fdbbefbdd2399a9e24)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:11.656390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:11.661846 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1118/2244] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:11.666441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6880ed-5758-4dc3-a10f-3c132c9f41c2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:11.675754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6880ed-5758-4dc3-a10f-3c132c9f41c2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:11.680712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:11.681444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.681761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.682062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.682946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:11.683310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:11.685181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:11.698669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1119/2245] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:11.699212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:11.703689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:11.709131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e73fe3d022847fdbbefbdd2399a9e24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.715116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973fa27-bafb-44fa-8d19-a077a5b01abc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:11.717230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e73fe3d022847fdbbefbdd2399a9e24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.720312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:11.720967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.721250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.721527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.722216 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:11.724144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:11.730277 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e73fe3d022847fdbbefbdd2399a9e24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.737999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e73fe3d022847fdbbefbdd2399a9e24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.738759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0e7e05e3-6ec3-484b-a15c-3bb64cf826a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e73fe3d022847fdbbefbdd2399a9e24'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:11.746116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1127/2246] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:11 2022] DELETE /identity/v3/users/4e73fe3d022847fdbbefbdd2399a9e24 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:11.750461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c514-e0ca-4160-a6de-701070649bf7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.750759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c514-e0ca-4160-a6de-701070649bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.751043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48c514-e0ca-4160-a6de-701070649bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.758910 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1120/2247] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:11 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:29:11.763554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:11.765854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.768281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ed48c514-e0ca-4160-a6de-701070649bf7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:11.769620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ed48c514-e0ca-4160-a6de-701070649bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.805713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:11.864161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d5214-3e75-4a93-ad0e-6491a7589870 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:11.871510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d25c28-0d75-40d9-b733-3eb913031d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:11.872434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25c28-0d75-40d9-b733-3eb913031d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.872867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25c28-0d75-40d9-b733-3eb913031d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.873345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d25c28-0d75-40d9-b733-3eb913031d02 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.874521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d25c28-0d75-40d9-b733-3eb913031d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:11.877527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d25c28-0d75-40d9-b733-3eb913031d02 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:11.909522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1121/2248] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:11 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:11.909522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b113-20e8-45fb-8fdd-5db4580238ac None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.909522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b113-20e8-45fb-8fdd-5db4580238ac None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.909522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7b113-20e8-45fb-8fdd-5db4580238ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.928369 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1128/2249] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:11.929439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c514-e0ca-4160-a6de-701070649bf7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:11.930258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bcf7b113-20e8-45fb-8fdd-5db4580238ac None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:11.931965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bcf7b113-20e8-45fb-8fdd-5db4580238ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:11.941399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48c514-e0ca-4160-a6de-701070649bf7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:11.956452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:11.957211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:11.957493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:11.958336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:11.958522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:11.960890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:11.972023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1129/2250] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:11.973384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:11.975672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:12.004202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1122/2251] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:29:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:12.005248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7b113-20e8-45fb-8fdd-5db4580238ac None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:12.018002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7b113-20e8-45fb-8fdd-5db4580238ac None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:12.023648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:12.024408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.024695 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.024990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.025806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:12.027462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:12.041709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1123/2252] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:12.043294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:12.045509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d0da1-ff60-4ca7-980c-e6bd09f3ec32 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:12.050407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:12.051138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.051557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.051880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.064104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:12.065757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5508d6-5454-4a94-8e64-e474f1af930b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:12.065874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:12.074506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1883a0-41ec-40f0-844d-a7dbde039433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:12.075600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1883a0-41ec-40f0-844d-a7dbde039433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.076186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1883a0-41ec-40f0-844d-a7dbde039433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.076186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1883a0-41ec-40f0-844d-a7dbde039433 admin admin] PATH_INFO: `/v3/projects/084c62dc90a54feaa480ad4cc052aa64/users/0cd7f8c93ba54203a8c143cb504a9caa/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.077403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1130/2253] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:12.078873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:12.080000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:12.108155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1883a0-41ec-40f0-844d-a7dbde039433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084c62dc90a54feaa480ad4cc052aa64, user_id=0cd7f8c93ba54203a8c143cb504a9caa, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:12.110896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1883a0-41ec-40f0-844d-a7dbde039433 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:12.129696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1124/2254] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:12 2022] PUT /identity/v3/projects/084c62dc90a54feaa480ad4cc052aa64/users/0cd7f8c93ba54203a8c143cb504a9caa/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:12.140182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:12.140867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.144290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.144290 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.181380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] MFA Rules not processed for user `0cd7f8c93ba54203a8c143cb504a9caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:12.183068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:12.183482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13349dc5-2049-4f53-ba32-cc35b159469c service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:12.290618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:12.292543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.292824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.293125 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.300823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1125/2255] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:12.317264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:12.319470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:12.368416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:12.383257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:12.384941 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:12.395652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1131/2256] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:29:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:29:12.396589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:12.401415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:12.448850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5279-18dd-42a9-9623-7f581d2dc37a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:12.457769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec3343-516b-40db-9ca7-086cb8264ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:12.458706 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3343-516b-40db-9ca7-086cb8264ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.459051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3343-516b-40db-9ca7-086cb8264ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.459292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3343-516b-40db-9ca7-086cb8264ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.485202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec3343-516b-40db-9ca7-086cb8264ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:12.487084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec3343-516b-40db-9ca7-086cb8264ab6 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:12.519623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1126/2257] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:12.532970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76d98f-9561-4e8c-b6a2-da379865cbe4 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:12.539469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:12.540595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.540985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.541357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] PATH_INFO: `/v3/users/82b27dbdbfeb464798b86e5ef9245a5e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.542765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b27dbdbfeb464798b86e5ef9245a5e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:12.544835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:12.647320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:12.693007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b27dbdbfeb464798b86e5ef9245a5e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:12.713365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b27dbdbfeb464798b86e5ef9245a5e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:12.753838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b27dbdbfeb464798b86e5ef9245a5e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:12.777375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b27dbdbfeb464798b86e5ef9245a5e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:12.778334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b27dbdbfeb464798b86e5ef9245a5e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:12.791368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:12.791967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:12.792191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:12.793040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1132/2258] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:12 2022] DELETE /identity/v3/users/82b27dbdbfeb464798b86e5ef9245a5e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:12.817247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:12.819745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:12.828797 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:12.830919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:12.986773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea54749-1b18-4202-8daa-5d8e66594df5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:12.999004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.000851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.001407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.001734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] PATH_INFO: `/v3/projects/86ae7517c1e4462ba70a83438354d897` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.004019 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ae7517c1e4462ba70a83438354d897)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.005123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1127/2259] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:13.006173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.017747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.020793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:13.136686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ae7517c1e4462ba70a83438354d897', 'request_id': 'req-6c90569c-05dd-4118-8c4d-844c0222a909'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.155471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ae7517c1e4462ba70a83438354d897', 'request_id': 'req-6c90569c-05dd-4118-8c4d-844c0222a909'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.164257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ae7517c1e4462ba70a83438354d897', 'request_id': 'req-6c90569c-05dd-4118-8c4d-844c0222a909'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.192756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] The token cache is being invalidate because project 86ae7517c1e4462ba70a83438354d897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:13.193248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.194110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6c90569c-05dd-4118-8c4d-844c0222a909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.196999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1133/2260] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:12 2022] DELETE /identity/v3/projects/86ae7517c1e4462ba70a83438354d897 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:13.198724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94373a-a43f-44c0-b3a2-9df1c68cdf3e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.203191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8f02-19ee-4859-a93d-38a90c404e9d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.203191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8f02-19ee-4859-a93d-38a90c404e9d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.203191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e8f02-19ee-4859-a93d-38a90c404e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.230486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c97e8f02-19ee-4859-a93d-38a90c404e9d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:13.231530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c97e8f02-19ee-4859-a93d-38a90c404e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:13.274406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:13.305626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.306561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.306719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.307002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.309313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:13.313001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1134/2261] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:13.323305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca09fe-d3ec-440f-9673-e011bd285129 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.323556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca09fe-d3ec-440f-9673-e011bd285129 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.323909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca09fe-d3ec-440f-9673-e011bd285129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.337046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.338545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.350587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1128/2262] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:29:13.363205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-feca09fe-d3ec-440f-9673-e011bd285129 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:13.364615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-feca09fe-d3ec-440f-9673-e011bd285129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:13.379283 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.386028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1135/2263] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:13.389824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8534d9-3327-476f-8fea-9c550866bc8e service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.394733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.395404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.395684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.395959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.396825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:13.397128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.399176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.414089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1129/2264] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:13.418997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca09fe-d3ec-440f-9673-e011bd285129 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.430575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca09fe-d3ec-440f-9673-e011bd285129 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.435383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.436066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.436351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.436650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.437348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.439373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.469908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1136/2265] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:13 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:29:13.474215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.479621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:13.486143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9021387-c3f8-4ed6-a005-4997dce688b5 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.565922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.566640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.566988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.567197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.567928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.569903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.602521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1130/2266] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:13 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:13.603453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.618199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293e53-baee-40fc-b763-ae1a742e542b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.626928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.627501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.628142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.628142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.628827 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.635263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.656923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1137/2267] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:13.658225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.670275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689467e0-a430-45ff-baa0-85aca8d9851e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.688823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.690474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.690474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.690474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.691380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.693339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.708612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.711287 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:13.728397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1131/2268] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:13.738622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.749976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5a44c-735b-436c-b738-0716c46246e0 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.761034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadff82-08c9-4ede-b897-4a9db621b358 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:13.767193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.768169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.768436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.768704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db64568-cfc4-4801-8cef-c526348a5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:13.768849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] PATH_INFO: `/v3/projects/8a747a3426eb4562a66b0b5d067ac0b5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.769907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a747a3426eb4562a66b0b5d067ac0b5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.770477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db64568-cfc4-4801-8cef-c526348a5665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.770915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db64568-cfc4-4801-8cef-c526348a5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.771336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db64568-cfc4-4801-8cef-c526348a5665 admin admin] PATH_INFO: `/v3/projects/ac64b737a78544f2a90d610708082eee/users/8dd3035ec54f49f4ba0aec447532f7ea/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.772647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.790036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db64568-cfc4-4801-8cef-c526348a5665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac64b737a78544f2a90d610708082eee, user_id=8dd3035ec54f49f4ba0aec447532f7ea, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:13.793013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db64568-cfc4-4801-8cef-c526348a5665 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:13.813019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1132/2269] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:13 2022] PUT /identity/v3/projects/ac64b737a78544f2a90d610708082eee/users/8dd3035ec54f49f4ba0aec447532f7ea/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:13.818197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:13.818563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:13.819321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:13.839174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a747a3426eb4562a66b0b5d067ac0b5', 'request_id': 'req-73bdbb5b-591d-46c2-b1c0-5440c0162989'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.843419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:13.844953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:13.853086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a747a3426eb4562a66b0b5d067ac0b5', 'request_id': 'req-73bdbb5b-591d-46c2-b1c0-5440c0162989'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.863132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a747a3426eb4562a66b0b5d067ac0b5', 'request_id': 'req-73bdbb5b-591d-46c2-b1c0-5440c0162989'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.895329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] The token cache is being invalidate because project 8a747a3426eb4562a66b0b5d067ac0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:13.895329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.909808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:13.927095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1138/2270] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:13 2022] DELETE /identity/v3/projects/8a747a3426eb4562a66b0b5d067ac0b5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:13.938339 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:13.955117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:14.021791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1133/2271] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:14.042445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:14.050394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:14.076951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdbb5b-591d-46c2-b1c0-5440c0162989 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:14.086182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:14.088654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:14.089056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:14.089626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] PATH_INFO: `/v3/users/03e18fcd02584830b87d593247448e6e` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:14.091290 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e18fcd02584830b87d593247448e6e)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:14.094694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:14.163592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:14.204168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e18fcd02584830b87d593247448e6e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:14.212001 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb0002-e1fd-45bb-aa39-11d79c252315 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:14.216786 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e18fcd02584830b87d593247448e6e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:14.221307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:14.222454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:14.223004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:14.223913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:14.240467 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:14.243882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:14.244416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e18fcd02584830b87d593247448e6e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:14.256637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:14.263424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e18fcd02584830b87d593247448e6e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:14.268898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b186f2b6-123f-4ab9-8ff0-531eec641aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e18fcd02584830b87d593247448e6e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:14.278404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1134/2272] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:14.282781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1139/2273] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:13 2022] DELETE /identity/v3/users/03e18fcd02584830b87d593247448e6e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:15.350048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:15.362623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b90c6d-f897-4322-a98b-f5afd7604542 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:15.489881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:15.493284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:15.493569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:15.494101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] PATH_INFO: `/v3/projects/5d38a25b72b440efb41d1adf48580769` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:15.498925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d38a25b72b440efb41d1adf48580769)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:15.501698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:15.602760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d38a25b72b440efb41d1adf48580769', 'request_id': 'req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:15.612131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d38a25b72b440efb41d1adf48580769', 'request_id': 'req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:15.624217 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d38a25b72b440efb41d1adf48580769', 'request_id': 'req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:15.649148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] The token cache is being invalidate because project 5d38a25b72b440efb41d1adf48580769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:15.649451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:15.650173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-97c5284d-f4c5-4bd6-80e4-6b44be11f47d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:15.657513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1135/2274] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:15 2022] DELETE /identity/v3/projects/5d38a25b72b440efb41d1adf48580769 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:15.660205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2932-5c1a-43da-a684-2105e7320d75 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:15.660701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2932-5c1a-43da-a684-2105e7320d75 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:15.660782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2932-5c1a-43da-a684-2105e7320d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:15.685062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c44a2932-5c1a-43da-a684-2105e7320d75 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:15.686472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c44a2932-5c1a-43da-a684-2105e7320d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:15.769034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1140/2275] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:15.777351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76d47a-6ecd-4e1d-841c-7d7daa5d93d8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:15.777647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76d47a-6ecd-4e1d-841c-7d7daa5d93d8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:15.777925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76d47a-6ecd-4e1d-841c-7d7daa5d93d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:15.797629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-dd76d47a-6ecd-4e1d-841c-7d7daa5d93d8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:15.798869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-dd76d47a-6ecd-4e1d-841c-7d7daa5d93d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:15.811552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1136/2276] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:15.813106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2932-5c1a-43da-a684-2105e7320d75 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:15.824606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2932-5c1a-43da-a684-2105e7320d75 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:15.842435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:15.843462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:15.843586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:15.843852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:15.845184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:15.845519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:15.848271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:15.877756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1141/2277] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:15.880538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76d47a-6ecd-4e1d-841c-7d7daa5d93d8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:15.899484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76d47a-6ecd-4e1d-841c-7d7daa5d93d8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:15.908023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:15.909905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:15.910191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:15.910526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:15.911889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:15.915740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:15.967747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1137/2278] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:15 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:15.972156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:16.008478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438a7a-08bb-48e8-ae72-914ed53e33b8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:16.145363 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:16.146265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.146706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.147104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.148110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:16.150279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:16.199425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1142/2279] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:15 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:29:16.203845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:16.220776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafdb95-ddba-433f-bd73-d781f76ff84a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:16.229459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:16.230601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.231067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.231891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.233958 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:16.238892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:16.264996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:16.290698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1138/2280] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:16.302387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4d7f-311f-4859-9a74-1bc2485e6c42 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:16.315145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ae180-504a-48a2-a254-5882194c7338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:16.317073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae180-504a-48a2-a254-5882194c7338 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.317765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae180-504a-48a2-a254-5882194c7338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.318047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae180-504a-48a2-a254-5882194c7338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.318894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ae180-504a-48a2-a254-5882194c7338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:16.325222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ae180-504a-48a2-a254-5882194c7338 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:16.397018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:16.414440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1143/2281] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:16.423086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6491df8-9411-4ca7-888b-2edf4420a114 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:16.454334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:16.454334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.454334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.454334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] PATH_INFO: `/v3/projects/9967455c69804124868a7cc38e9ad6c0/users/11c8337adfe940ab86567a43d8e0c25b/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.488378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9967455c69804124868a7cc38e9ad6c0, user_id=11c8337adfe940ab86567a43d8e0c25b, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:16.494624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:16.533307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1139/2282] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:16 2022] PUT /identity/v3/projects/9967455c69804124868a7cc38e9ad6c0/users/11c8337adfe940ab86567a43d8e0c25b/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:16.544687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96172ba-6313-496f-b411-adbe4f5a5ae7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.545385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96172ba-6313-496f-b411-adbe4f5a5ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.545523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96172ba-6313-496f-b411-adbe4f5a5ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.554133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:16.556845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:16.606771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:16.634702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b96172ba-6313-496f-b411-adbe4f5a5ae7 None None] MFA Rules not processed for user `11c8337adfe940ab86567a43d8e0c25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:16.635866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b96172ba-6313-496f-b411-adbe4f5a5ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:16.654034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:16.725033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42bce4a-974a-476e-b35d-22bf0e206f94 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:16.730767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:16.732319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.732601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.733018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] PATH_INFO: `/v3/users/0cd7f8c93ba54203a8c143cb504a9caa` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.734496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd7f8c93ba54203a8c143cb504a9caa)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:16.736847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:16.814750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd7f8c93ba54203a8c143cb504a9caa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:16.815669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd7f8c93ba54203a8c143cb504a9caa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:16.816433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd7f8c93ba54203a8c143cb504a9caa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:16.831494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd7f8c93ba54203a8c143cb504a9caa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:16.834402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1144/2283] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:16.839104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96172ba-6313-496f-b411-adbe4f5a5ae7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:16.850198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1ae437a-dbc1-4d34-9de2-6b2b0af8f758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd7f8c93ba54203a8c143cb504a9caa'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:16.855604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96172ba-6313-496f-b411-adbe4f5a5ae7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:16.872702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1140/2284] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:16 2022] DELETE /identity/v3/users/0cd7f8c93ba54203a8c143cb504a9caa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:16.877919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:16.878641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.878928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.879270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.879895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:16.880847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:16.881765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:16.881897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:16.882478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:16.904072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:16.905622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:16.940177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1145/2285] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:16 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:16.945332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:16.950650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:16.988579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1141/2286] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:17.008120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:17.013656 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:17.114382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:17.134692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60606c95-55b9-420e-8e24-ae7a47891181 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:17.176247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89285f0-7596-4f7b-94aa-4f177871a9f9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:17.191863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:17.192717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:17.192998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:17.193306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:17.208151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:17.211659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:17.244039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:17.244614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:17.245014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:17.245431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:17.246045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1146/2287] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:16 2022] POST /identity/v3/users => generated 296 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:29:17.250251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:17.268261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5060c-f4f2-4df6-aba2-9941b10a1b89 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:17.270349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:17.272363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:17.274903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:17.276228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:17.276228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:17.276698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:17.277716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:17.280180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:17.289762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1142/2288] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:17.298418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:17.299174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1147/2289] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:17.319697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79ef-fef8-406e-bb4c-10dfab600f12 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:17.326006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:17.326989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:17.327268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:17.327542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] PATH_INFO: `/v3/projects/40fb3ae40afe4a13b101870cd1266e65/users/188c3defe1a046219c1ff4aca4d47838/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:17.350804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fb3ae40afe4a13b101870cd1266e65, user_id=188c3defe1a046219c1ff4aca4d47838, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:17.354722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:17.412584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1143/2290] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:17 2022] PUT /identity/v3/projects/40fb3ae40afe4a13b101870cd1266e65/users/188c3defe1a046219c1ff4aca4d47838/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:17.417102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:17.445549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12b82c-6d81-4a18-acaa-318fbd769f61 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:17.607024 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:17.628560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cebf1-9023-4320-97bd-a21e6b28151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:17.629364 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cebf1-9023-4320-97bd-a21e6b28151d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:17.629666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cebf1-9023-4320-97bd-a21e6b28151d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:17.629947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cebf1-9023-4320-97bd-a21e6b28151d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:17.631023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cebf1-9023-4320-97bd-a21e6b28151d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:17.634322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cebf1-9023-4320-97bd-a21e6b28151d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:17.657721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1148/2291] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:17.659182 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:17.708262 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e956f-779e-46dd-8f3d-ceaf7608a888 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:17.731045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:17.735468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:17.735766 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:17.736048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] PATH_INFO: `/v3/projects/40fb3ae40afe4a13b101870cd1266e65/users/188c3defe1a046219c1ff4aca4d47838/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:17.740753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fb3ae40afe4a13b101870cd1266e65, user_id=188c3defe1a046219c1ff4aca4d47838, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:17.754219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:17.817689 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1144/2292] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:17 2022] PUT /identity/v3/projects/40fb3ae40afe4a13b101870cd1266e65/users/188c3defe1a046219c1ff4aca4d47838/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:17.833743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:17.833743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:17.833743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:17.886712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] MFA Rules not processed for user `188c3defe1a046219c1ff4aca4d47838`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:17.893387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:17.991971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1149/2293] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:18.001069 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:18.003265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:18.113969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:18.116048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:18.126914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e978729-2ad2-4b95-80fd-f64011930d27 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:18.133274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121511b8-3015-4ff2-a16a-3c79f10dd4a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:18.134053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121511b8-3015-4ff2-a16a-3c79f10dd4a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:18.134230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121511b8-3015-4ff2-a16a-3c79f10dd4a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:18.135029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121511b8-3015-4ff2-a16a-3c79f10dd4a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:18.137985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-121511b8-3015-4ff2-a16a-3c79f10dd4a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:18.302616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121511b8-3015-4ff2-a16a-3c79f10dd4a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:18.304983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121511b8-3015-4ff2-a16a-3c79f10dd4a5 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:18.310356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c288ab7-763c-402e-84aa-d731eb82b867 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:18.319608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:18.320897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:18.321408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:18.321978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] PATH_INFO: `/v3/projects/084c62dc90a54feaa480ad4cc052aa64` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:18.322991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1145/2294] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:18.324402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084c62dc90a54feaa480ad4cc052aa64)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:18.326953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:18.452639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084c62dc90a54feaa480ad4cc052aa64', 'request_id': 'req-98d20220-0af8-493e-975f-fe8dcc9553f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:18.462885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084c62dc90a54feaa480ad4cc052aa64', 'request_id': 'req-98d20220-0af8-493e-975f-fe8dcc9553f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:18.480440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084c62dc90a54feaa480ad4cc052aa64', 'request_id': 'req-98d20220-0af8-493e-975f-fe8dcc9553f1'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:18.498138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] The token cache is being invalidate because project 084c62dc90a54feaa480ad4cc052aa64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:18.498665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:18.500357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-98d20220-0af8-493e-975f-fe8dcc9553f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:18.506337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1150/2295] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:18 2022] DELETE /identity/v3/projects/084c62dc90a54feaa480ad4cc052aa64 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:18.508423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54cfae-16e5-41fa-8080-c37d4a9636be None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:18.508981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54cfae-16e5-41fa-8080-c37d4a9636be None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:18.508981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54cfae-16e5-41fa-8080-c37d4a9636be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:18.549358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3e54cfae-16e5-41fa-8080-c37d4a9636be None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:18.550833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3e54cfae-16e5-41fa-8080-c37d4a9636be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:18.619230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:18.735727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1146/2296] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:18.743794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77a0f4-b8f1-4e8d-88dc-3eb2845293ff None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:18.744134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77a0f4-b8f1-4e8d-88dc-3eb2845293ff None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:18.744899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77a0f4-b8f1-4e8d-88dc-3eb2845293ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:18.783895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:18.795515 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6c77a0f4-b8f1-4e8d-88dc-3eb2845293ff None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:18.796597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6c77a0f4-b8f1-4e8d-88dc-3eb2845293ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:18.836545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1151/2297] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:18.840534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54cfae-16e5-41fa-8080-c37d4a9636be None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:18.857081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54cfae-16e5-41fa-8080-c37d4a9636be None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:18.871847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:18.872560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:18.872882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:18.873198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:18.873971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:18.874308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:18.876036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:18.909570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1147/2298] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:18.913905 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77a0f4-b8f1-4e8d-88dc-3eb2845293ff None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:18.930921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77a0f4-b8f1-4e8d-88dc-3eb2845293ff None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:18.943995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:18.945575 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:18.946086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:18.946583 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:18.947850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:18.950026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:18.999022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1152/2299] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:18 2022] POST /identity/v3/projects => generated 389 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:18.999699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:19.014427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2457b6-5e0d-401d-9b09-134f868a0db9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:19.156450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:19.157741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:19.159505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:19.159505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:19.161045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:19.166062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:19.232183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1148/2300] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:18 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:19.234518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:19.248833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1d56-7dc9-4398-b44c-66b29740d79c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:19.254465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:19.254762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:19.255146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:19.255518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:19.256780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:19.259966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:19.277630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1153/2301] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:19.279036 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:19.291158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade75b9-fbe2-456d-a0be-c762d6fea6b0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:19.296365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84607c00-5c8f-4910-b7a5-adc3018edf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:19.297176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84607c00-5c8f-4910-b7a5-adc3018edf3d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:19.297555 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84607c00-5c8f-4910-b7a5-adc3018edf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:19.297953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84607c00-5c8f-4910-b7a5-adc3018edf3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:19.298911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84607c00-5c8f-4910-b7a5-adc3018edf3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:19.300750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84607c00-5c8f-4910-b7a5-adc3018edf3d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:19.326105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1149/2302] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:19.330522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:19.348593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316ea05-8e20-4c1e-a550-fd2fcdb61c97 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:19.380446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:19.381695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:19.382489 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:19.382943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] PATH_INFO: `/v3/projects/f797132418234772b3149a350860d652/users/015e4c68839f4632b6f8bee57450dc0b/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:19.414957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f797132418234772b3149a350860d652, user_id=015e4c68839f4632b6f8bee57450dc0b, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:19.419206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:19.454379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1154/2303] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:19 2022] PUT /identity/v3/projects/f797132418234772b3149a350860d652/users/015e4c68839f4632b6f8bee57450dc0b/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:19.464013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:19.464692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:19.465222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:19.511129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] MFA Rules not processed for user `015e4c68839f4632b6f8bee57450dc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:19.512705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:19.643942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1150/2304] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:19.656436 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:19.660849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:19.899500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f10b7-7527-49c7-b057-46f39e3dcfb2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:19.915229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd156cd-7068-4b02-9c0c-c2e0128be620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:19.917612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd156cd-7068-4b02-9c0c-c2e0128be620 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:19.917993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd156cd-7068-4b02-9c0c-c2e0128be620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:19.918576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd156cd-7068-4b02-9c0c-c2e0128be620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:19.940714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd156cd-7068-4b02-9c0c-c2e0128be620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:19.942896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd156cd-7068-4b02-9c0c-c2e0128be620 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:19.970704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1155/2305] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:20.188291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:20.190531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:20.218797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72e678-23e9-49c0-8a64-6286385a6245 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:20.226070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:20.226899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:20.227104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:20.227522 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:20.229396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:20.248509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:20.348885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:20.350504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:20.366904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1151/2306] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:22.668347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198b4df-c6a1-4635-a1bb-d48b6a9eeadf None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:22.668833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198b4df-c6a1-4635-a1bb-d48b6a9eeadf None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:22.669031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198b4df-c6a1-4635-a1bb-d48b6a9eeadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:22.777001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6198b4df-c6a1-4635-a1bb-d48b6a9eeadf None None] MFA Rules not processed for user `8dd3035ec54f49f4ba0aec447532f7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:22.778750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6198b4df-c6a1-4635-a1bb-d48b6a9eeadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:22.883726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1156/2307] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:22.884987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:22.887620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:23.044212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567095c-eb0e-4b79-afaa-380e698ea1f4 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:23.052149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4f4e6-de6d-43f0-bf43-bf1d2e1c169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:23.058010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f4e6-de6d-43f0-bf43-bf1d2e1c169d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:23.058010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f4e6-de6d-43f0-bf43-bf1d2e1c169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:23.058010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4f4e6-de6d-43f0-bf43-bf1d2e1c169d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:23.058010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4f4e6-de6d-43f0-bf43-bf1d2e1c169d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:23.059459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4f4e6-de6d-43f0-bf43-bf1d2e1c169d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:23.122073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1152/2308] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:22 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:23.126695 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198b4df-c6a1-4635-a1bb-d48b6a9eeadf None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:23.145292 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198b4df-c6a1-4635-a1bb-d48b6a9eeadf None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:23.332692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:23.409166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:23.409886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:23.410175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:23.411074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:23.411199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:23.416820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:23.430082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:23.430545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:23.430832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:23.498942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1157/2309] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:23 2022] POST /identity/v3/users => generated 299 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:23.504571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:23.516028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:23.524056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:23.534631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219dcf8-6d2d-4845-b14c-52c364952f65 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:23.547203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:23.548168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:23.549573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:23.566132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:23.567704 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:23.574918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:23.605613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1158/2310] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:23.612078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:23.660691 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c5be64-5e3a-4730-b036-d370e8200d0d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:23.674507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:23.676185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:23.676649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:23.677240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] PATH_INFO: `/v3/projects/e35f2a3b63e04d83a92f742cd94e5553/users/76300bea457345ffb9a0bf8bad80ae0c/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:23.715212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35f2a3b63e04d83a92f742cd94e5553, user_id=76300bea457345ffb9a0bf8bad80ae0c, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:23.737813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:23.782263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1159/2311] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:23 2022] PUT /identity/v3/projects/e35f2a3b63e04d83a92f742cd94e5553/users/76300bea457345ffb9a0bf8bad80ae0c/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:23.786128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:23.790918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1153/2312] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:29:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:23.809897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:23.815796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:23.944152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7e393-5235-41db-829a-f19791c289c3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:23.961706 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:23.962893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:23.963666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:23.964209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:23.965286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:23.967380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:23.991996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1160/2313] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:29:24.003021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:24.016969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600ca8-64b0-4267-9fcb-ac3d9edac60e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:24.026184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:24.030090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:24.032685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:24.035871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:24.036481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] PATH_INFO: `/v3/projects/e35f2a3b63e04d83a92f742cd94e5553/users/76300bea457345ffb9a0bf8bad80ae0c/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:24.041899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35f2a3b63e04d83a92f742cd94e5553, user_id=76300bea457345ffb9a0bf8bad80ae0c, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:24.047450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:24.091636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1161/2314] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:24 2022] PUT /identity/v3/projects/e35f2a3b63e04d83a92f742cd94e5553/users/76300bea457345ffb9a0bf8bad80ae0c/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:24.106819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb98055-1185-45b2-a9d1-c23d47bbbdbc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:24.273830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e381c4-fa9d-4fdf-b8a6-121498bef0e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:24.275822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e381c4-fa9d-4fdf-b8a6-121498bef0e7 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:24.277667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e381c4-fa9d-4fdf-b8a6-121498bef0e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:24.278033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e381c4-fa9d-4fdf-b8a6-121498bef0e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:24.447505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e381c4-fa9d-4fdf-b8a6-121498bef0e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:24.454692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e381c4-fa9d-4fdf-b8a6-121498bef0e7 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:24.476524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1154/2315] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 17:29:25.057295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:25.059394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:25.183227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62eb50-24e8-4154-abb0-88e5baa3d61d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:25.214029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:25.215975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:25.216301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:25.216632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] PATH_INFO: `/v3/users/11c8337adfe940ab86567a43d8e0c25b` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:25.218918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c8337adfe940ab86567a43d8e0c25b)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:25.225755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:25.250195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:25.316594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c8337adfe940ab86567a43d8e0c25b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:25.335012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c8337adfe940ab86567a43d8e0c25b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:25.351438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c8337adfe940ab86567a43d8e0c25b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:25.360117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c8337adfe940ab86567a43d8e0c25b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:25.360877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c8337adfe940ab86567a43d8e0c25b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:25.372734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1162/2316] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:25 2022] DELETE /identity/v3/users/11c8337adfe940ab86567a43d8e0c25b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:25.377470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:25.377973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:25.378164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:25.431200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:25.433213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:25.641830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1155/2317] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:25.710070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:25.714610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:25.943565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb996-4c87-4403-8f4e-5fbf3621f62d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:25.973788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:25.974777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:25.974903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:25.975113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:26.007316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:26.009326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:26.056371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1163/2318] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:27.053595 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:27.055480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:27.088380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ecd6e-2883-4dbe-95f1-ced02a92c8f2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:27.104181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:27.105092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:27.105373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:27.111111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] PATH_INFO: `/v3/projects/9967455c69804124868a7cc38e9ad6c0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:27.115358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9967455c69804124868a7cc38e9ad6c0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:27.123964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:27.228436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:27.324760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9967455c69804124868a7cc38e9ad6c0', 'request_id': 'req-a2903c69-1f7d-40bd-8d72-461c13ac1dce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.341499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9967455c69804124868a7cc38e9ad6c0', 'request_id': 'req-a2903c69-1f7d-40bd-8d72-461c13ac1dce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.370087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9967455c69804124868a7cc38e9ad6c0', 'request_id': 'req-a2903c69-1f7d-40bd-8d72-461c13ac1dce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.407936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] The token cache is being invalidate because project 9967455c69804124868a7cc38e9ad6c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:27.408411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.411606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.415085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1156/2319] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:27 2022] DELETE /identity/v3/projects/9967455c69804124868a7cc38e9ad6c0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:27.418866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:27.435050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a1c57-517a-484a-8a16-2c4c6b554e55 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:27.708810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:27.714278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:27.716234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:27.716694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] PATH_INFO: `/v3/users/188c3defe1a046219c1ff4aca4d47838` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:27.720306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=188c3defe1a046219c1ff4aca4d47838)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:27.722811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:27.867225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:27.913502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188c3defe1a046219c1ff4aca4d47838'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.934881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188c3defe1a046219c1ff4aca4d47838'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.960514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188c3defe1a046219c1ff4aca4d47838'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.993064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188c3defe1a046219c1ff4aca4d47838'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:27.994651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c1a9ad3d-9933-4cbe-acdb-58f7e5508bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188c3defe1a046219c1ff4aca4d47838'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:28.014530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1164/2320] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:27 2022] DELETE /identity/v3/users/188c3defe1a046219c1ff4aca4d47838 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:29.626006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:29.629156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:29.656306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2903c69-1f7d-40bd-8d72-461c13ac1dce admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:29.904799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:29.906159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:29.906640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:29.907015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] PATH_INFO: `/v3/projects/40fb3ae40afe4a13b101870cd1266e65` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:29.910443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fb3ae40afe4a13b101870cd1266e65)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:29.919585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:30.084682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fb3ae40afe4a13b101870cd1266e65', 'request_id': 'req-a19045fd-1105-450a-af2c-c9bf3e48220e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:30.119280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fb3ae40afe4a13b101870cd1266e65', 'request_id': 'req-a19045fd-1105-450a-af2c-c9bf3e48220e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:30.141854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fb3ae40afe4a13b101870cd1266e65', 'request_id': 'req-a19045fd-1105-450a-af2c-c9bf3e48220e'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:30.179233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] The token cache is being invalidate because project 40fb3ae40afe4a13b101870cd1266e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:30.180815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:30.183123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a19045fd-1105-450a-af2c-c9bf3e48220e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:30.188868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1157/2321] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:29 2022] DELETE /identity/v3/projects/40fb3ae40afe4a13b101870cd1266e65 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:30.195329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e212-758a-43a4-aada-d00ea4b10653 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:30.195911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e212-758a-43a4-aada-d00ea4b10653 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:30.196155 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e212-758a-43a4-aada-d00ea4b10653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:30.254048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f755e212-758a-43a4-aada-d00ea4b10653 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:30.255491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f755e212-758a-43a4-aada-d00ea4b10653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:30.435720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1165/2322] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:30.437882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc69baf-3925-4286-a4f0-480196f919fe None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:30.438503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc69baf-3925-4286-a4f0-480196f919fe None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:30.439324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc69baf-3925-4286-a4f0-480196f919fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:30.505854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3fc69baf-3925-4286-a4f0-480196f919fe None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:30.514510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3fc69baf-3925-4286-a4f0-480196f919fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:30.568439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1158/2323] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:30.570438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755e212-758a-43a4-aada-d00ea4b10653 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:30.616466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755e212-758a-43a4-aada-d00ea4b10653 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:30.655694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:30.658093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:30.658545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:30.658860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:30.659800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:30.663446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:30.665958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:30.684205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1166/2324] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:30.688862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc69baf-3925-4286-a4f0-480196f919fe None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:30.704673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc69baf-3925-4286-a4f0-480196f919fe None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:30.719445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:30.725148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:30.725480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:30.725719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:30.742067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:30.753379 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:30.850810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1159/2325] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:30 2022] POST /identity/v3/projects => generated 359 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:30.855301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:30.884747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba02ca4-4481-4921-9302-38d9b22248fc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:30.990208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:30.991579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:30.992097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:30.993267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:30.994966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:30.997496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:31.081326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1167/2326] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:30 2022] POST /identity/v3/users => generated 280 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:29:31.085978 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:31.119812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55c553-1e26-420d-ba54-03de85f87472 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:31.132896 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:31.134677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:31.135882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:31.136300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:31.139736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:31.145980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:31.195223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:31.228713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1160/2327] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:31.230128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:31.255771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fd76c-4181-4222-8340-ae6a0fd59c63 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:31.277617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994b39e-274f-493d-8325-e6e8c5cd4d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:31.278554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994b39e-274f-493d-8325-e6e8c5cd4d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:31.278983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994b39e-274f-493d-8325-e6e8c5cd4d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:31.280207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994b39e-274f-493d-8325-e6e8c5cd4d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:31.281252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994b39e-274f-493d-8325-e6e8c5cd4d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:31.284127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994b39e-274f-493d-8325-e6e8c5cd4d7d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:31.342713 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1168/2328] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:31.344260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:31.367314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac8135-c4af-4995-b5a0-ea4678fdb2fa admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:31.414733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:31.415969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:31.416406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:31.416954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] PATH_INFO: `/v3/projects/e8f149c873ff4cabb1d300384b01efc9/users/465fb278aa6046b0a05aa83f95dc18e5/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:31.493513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f149c873ff4cabb1d300384b01efc9, user_id=465fb278aa6046b0a05aa83f95dc18e5, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:31.506662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:31.560594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1161/2329] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:31 2022] PUT /identity/v3/projects/e8f149c873ff4cabb1d300384b01efc9/users/465fb278aa6046b0a05aa83f95dc18e5/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:31.571128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb230-17bf-4d78-801d-301ec0b5b3cd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:31.571417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb230-17bf-4d78-801d-301ec0b5b3cd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:31.571770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eb230-17bf-4d78-801d-301ec0b5b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:31.664548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ab2eb230-17bf-4d78-801d-301ec0b5b3cd None None] MFA Rules not processed for user `465fb278aa6046b0a05aa83f95dc18e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:31.665804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab2eb230-17bf-4d78-801d-301ec0b5b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:31.678198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:31.843511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1169/2330] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:31 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:32.266093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:32.269168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:32.518329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84334cff-cabf-45d4-abf3-c6be8260975d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:32.524230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e4d5b-d3f0-41f8-8db2-924da9c28c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:32.525016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4d5b-d3f0-41f8-8db2-924da9c28c0a service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:32.525294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4d5b-d3f0-41f8-8db2-924da9c28c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:32.525573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e4d5b-d3f0-41f8-8db2-924da9c28c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:32.608067 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4d5b-d3f0-41f8-8db2-924da9c28c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:32.609824 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e4d5b-d3f0-41f8-8db2-924da9c28c0a service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:32.664421 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1162/2331] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:32 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:32.682097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eb230-17bf-4d78-801d-301ec0b5b3cd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:32.960893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eb230-17bf-4d78-801d-301ec0b5b3cd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:32.975151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:32.983399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:32.983809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:32.984157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] PATH_INFO: `/v3/users/465fb278aa6046b0a05aa83f95dc18e5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:32.989441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=465fb278aa6046b0a05aa83f95dc18e5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:32.997870 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:33.107371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465fb278aa6046b0a05aa83f95dc18e5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:33.140419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465fb278aa6046b0a05aa83f95dc18e5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:33.187647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465fb278aa6046b0a05aa83f95dc18e5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:33.207132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465fb278aa6046b0a05aa83f95dc18e5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:33.208199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465fb278aa6046b0a05aa83f95dc18e5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:33.217475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1170/2332] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:32 2022] DELETE /identity/v3/users/465fb278aa6046b0a05aa83f95dc18e5 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:33.222494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:33.222751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:33.223448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:33.285211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:33.288755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:33.551902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1163/2333] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:33.563901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:33.566862 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:33.655868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:33.724578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224855a-d86d-476e-8dcb-4100d459e0bb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:33.737059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec70c8-62eb-48ff-855b-07be319880ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:33.738828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec70c8-62eb-48ff-855b-07be319880ee service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:33.739120 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec70c8-62eb-48ff-855b-07be319880ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:33.739401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec70c8-62eb-48ff-855b-07be319880ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:33.756854 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec70c8-62eb-48ff-855b-07be319880ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:33.758724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec70c8-62eb-48ff-855b-07be319880ee service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:33.780932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1171/2334] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:34.677844 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:34.679883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:34.720684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5216aac-a10b-408d-b12c-3a13b4148543 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:34.746609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:34.748940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:34.753318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:34.753863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] PATH_INFO: `/v3/users/015e4c68839f4632b6f8bee57450dc0b` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:34.758548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=015e4c68839f4632b6f8bee57450dc0b)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:34.764999 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:34.945500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015e4c68839f4632b6f8bee57450dc0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:34.948244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015e4c68839f4632b6f8bee57450dc0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:34.950380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015e4c68839f4632b6f8bee57450dc0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:34.967228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015e4c68839f4632b6f8bee57450dc0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:35.004241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015e4c68839f4632b6f8bee57450dc0b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:35.011146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:35.039951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1164/2335] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:34 2022] DELETE /identity/v3/users/015e4c68839f4632b6f8bee57450dc0b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:35.041729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:35.042234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:35.042357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:35.084195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:35.089702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:35.424538 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1172/2336] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:35.441960 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:35.445158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:35.477604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c0a3f-1b8c-478d-a9aa-7df22cf7d61e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:35.496305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:35.497215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:35.497515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:35.497777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] PATH_INFO: `/v3/projects/e8f149c873ff4cabb1d300384b01efc9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:35.502226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f149c873ff4cabb1d300384b01efc9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:35.512394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:35.535353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:35.537341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:35.711341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cffb19-9223-46fa-abf5-c51e0edea2e3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:35.751688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f149c873ff4cabb1d300384b01efc9', 'request_id': 'req-605e8f26-be5b-4073-90d7-88b37804c554'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:35.769761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f149c873ff4cabb1d300384b01efc9', 'request_id': 'req-605e8f26-be5b-4073-90d7-88b37804c554'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:35.788172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f149c873ff4cabb1d300384b01efc9', 'request_id': 'req-605e8f26-be5b-4073-90d7-88b37804c554'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:35.820387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] The token cache is being invalidate because project e8f149c873ff4cabb1d300384b01efc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:35.822816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:35.827610 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-605e8f26-be5b-4073-90d7-88b37804c554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:35.831158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1165/2337] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:35 2022] DELETE /identity/v3/projects/e8f149c873ff4cabb1d300384b01efc9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:35.839924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544b61-8d2b-412d-98d7-f4d7a320c381 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:35.840923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544b61-8d2b-412d-98d7-f4d7a320c381 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:35.841740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544b61-8d2b-412d-98d7-f4d7a320c381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:35.867376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:35.868134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:35.868433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:35.868701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:35.885610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:35.900625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f1544b61-8d2b-412d-98d7-f4d7a320c381 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:35.903402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f1544b61-8d2b-412d-98d7-f4d7a320c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:36.073637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:36.102628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1166/2338] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:36.104503 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac52fd-0dec-48d7-810a-07496e0a5a04 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:36.104821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac52fd-0dec-48d7-810a-07496e0a5a04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:36.105081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac52fd-0dec-48d7-810a-07496e0a5a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:36.136809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:36.140997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:36.150302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2aac52fd-0dec-48d7-810a-07496e0a5a04 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:36.153697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2aac52fd-0dec-48d7-810a-07496e0a5a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:36.172562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1173/2339] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:36.175187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1167/2340] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:36.179927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:36.201963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83980ca9-a9aa-48bd-8f22-de5e0049db1e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:36.217939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:36.218687 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:36.218956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:36.219236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:36.219987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:36.220298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:36.227536 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:36.280554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1174/2341] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:36.281825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac52fd-0dec-48d7-810a-07496e0a5a04 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:36.295131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac52fd-0dec-48d7-810a-07496e0a5a04 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:36.306983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:36.307953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:36.309254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:36.311265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:36.312017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:36.314048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:36.391010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1168/2342] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:36 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:36.391272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:36.409678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508a8db-5c8d-4ebc-b998-bc2f9531f598 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:36.705338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:36.711188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:36.713214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:36.713807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:36.715795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:36.720265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:36.782541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:36.785761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1175/2343] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:36 2022] POST /identity/v3/users => generated 287 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:29:36.800252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fe4bd-55d5-4d6a-9187-ba5bde353eee admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:36.810648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:36.811356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:36.811639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:36.811913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:36.815350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:36.817043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:36.848048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1169/2344] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:29:36.848741 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:36.864663 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5be03-3c3d-4e8a-9e5d-aeeb6c799c7d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:36.898240 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33574-9812-4121-a750-abeefda5fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:36.898986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33574-9812-4121-a750-abeefda5fffe admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:36.899250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33574-9812-4121-a750-abeefda5fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:36.899524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33574-9812-4121-a750-abeefda5fffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:36.900275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33574-9812-4121-a750-abeefda5fffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:36.901903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33574-9812-4121-a750-abeefda5fffe admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:36.935681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:36.938460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1176/2345] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:36.955129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc4339-3ced-4a1c-8f2a-66853cce1d77 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:36.964365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:36.965344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:36.965627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:36.967073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] PATH_INFO: `/v3/projects/90b47379b38a4e498c9a25bc81580cc2/users/370dec10c5b0431cab98209cd4491941/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:37.011613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b47379b38a4e498c9a25bc81580cc2, user_id=370dec10c5b0431cab98209cd4491941, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:37.022246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:37.081255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1170/2346] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:36 2022] PUT /identity/v3/projects/90b47379b38a4e498c9a25bc81580cc2/users/370dec10c5b0431cab98209cd4491941/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:37.082615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:37.083145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:37.083145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:37.151995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] MFA Rules not processed for user `370dec10c5b0431cab98209cd4491941`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:37.153280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:37.290462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1177/2347] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:37.301877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:37.303931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:37.344893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:37.486319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8bf64-34dc-438c-8cac-fd12c3ace904 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:37.511084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:37.513306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:37.514618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:37.515268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:37.551330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:37.554428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:37.557052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:37.563919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:37.607864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1171/2348] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:37.698847 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:37.785549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b28a9c-314b-4272-9c51-33a0523ff115 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:37.804482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:37.805715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:37.806147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:37.807247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] PATH_INFO: `/v3/projects/f797132418234772b3149a350860d652` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:37.810208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f797132418234772b3149a350860d652)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:37.813626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:37.957525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f797132418234772b3149a350860d652', 'request_id': 'req-154963cc-f02b-4c6c-bb82-5fb83c77b72b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:37.983679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f797132418234772b3149a350860d652', 'request_id': 'req-154963cc-f02b-4c6c-bb82-5fb83c77b72b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:37.991784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f797132418234772b3149a350860d652', 'request_id': 'req-154963cc-f02b-4c6c-bb82-5fb83c77b72b'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.025423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] The token cache is being invalidate because project f797132418234772b3149a350860d652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:38.025726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.030764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-154963cc-f02b-4c6c-bb82-5fb83c77b72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.033085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1178/2349] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:37 2022] DELETE /identity/v3/projects/f797132418234772b3149a350860d652 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:38.260652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:38.265736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:38.319679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780273d-8b57-48d4-b8fe-6ededb06f248 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:38.537629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:38.540255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:38.540678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:38.544859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] PATH_INFO: `/v3/users/a25711f5a38c48db8aa6b817a231951f` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:38.551152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a25711f5a38c48db8aa6b817a231951f)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:38.558301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:38.772742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a25711f5a38c48db8aa6b817a231951f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.773879 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a25711f5a38c48db8aa6b817a231951f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.775185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a25711f5a38c48db8aa6b817a231951f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.806492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a25711f5a38c48db8aa6b817a231951f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.883811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-54461430-2d7f-4347-b78f-0d1ff7e79ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a25711f5a38c48db8aa6b817a231951f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:38.910574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:38.911023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:38.911260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:38.947694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1172/2350] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:38 2022] DELETE /identity/v3/users/a25711f5a38c48db8aa6b817a231951f => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:38.952576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495a70c-2f8b-4ee9-a6f6-b9e9a38ffc08 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:38.952917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495a70c-2f8b-4ee9-a6f6-b9e9a38ffc08 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:38.953202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495a70c-2f8b-4ee9-a6f6-b9e9a38ffc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:38.995094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] MFA Rules not processed for user `76300bea457345ffb9a0bf8bad80ae0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:38.996332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:39.013839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3495a70c-2f8b-4ee9-a6f6-b9e9a38ffc08 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:39.022039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3495a70c-2f8b-4ee9-a6f6-b9e9a38ffc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:39.132316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:39.163229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1179/2351] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:39.232315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1173/2352] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:39.255682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:39.257151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:39.393988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:39.401602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7faa9-c1f1-4f06-89b9-a400deb6719e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:39.413343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:39.414178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:39.414307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:39.414608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:39.434262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:39.436142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:39.464541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1180/2353] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:39.861230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aaf23-7318-4448-a0af-f8fde7ff0c6d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:39.861705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aaf23-7318-4448-a0af-f8fde7ff0c6d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:39.861807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aaf23-7318-4448-a0af-f8fde7ff0c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:39.936942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3b7aaf23-7318-4448-a0af-f8fde7ff0c6d None None] MFA Rules not processed for user `58298868d67d4aa584a9fed53e4358a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:39.940236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3b7aaf23-7318-4448-a0af-f8fde7ff0c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:40.068881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:40.070503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:40.075577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1174/2354] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:40.099937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b485dd7-b8fe-4e9a-a7b6-84b45d77fd0d service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:40.107043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:40.108306 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:40.109014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:40.109423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] PATH_INFO: `/v3/projects/c34aec5d9efe4ab8bbf5ec110c61163a` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:40.111490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34aec5d9efe4ab8bbf5ec110c61163a)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:40.113602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:40.256500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34aec5d9efe4ab8bbf5ec110c61163a', 'request_id': 'req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:40.280071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34aec5d9efe4ab8bbf5ec110c61163a', 'request_id': 'req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:40.289806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34aec5d9efe4ab8bbf5ec110c61163a', 'request_id': 'req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:40.328794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] The token cache is being invalidate because project c34aec5d9efe4ab8bbf5ec110c61163a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:40.329203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:40.330745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-652edc9d-a9f4-495b-91fc-95a37f8a3eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:40.347764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1181/2355] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:40 2022] DELETE /identity/v3/projects/c34aec5d9efe4ab8bbf5ec110c61163a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:40.354308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb0663-e921-421d-afde-b196c11333ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:40.355233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb0663-e921-421d-afde-b196c11333ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:40.355716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb0663-e921-421d-afde-b196c11333ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:40.433239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-26eb0663-e921-421d-afde-b196c11333ee None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:40.435143 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-26eb0663-e921-421d-afde-b196c11333ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:40.614955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1175/2356] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:40.623637 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20019d7d-c925-458f-92ec-09cd2e737602 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:40.624238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20019d7d-c925-458f-92ec-09cd2e737602 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:40.624725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20019d7d-c925-458f-92ec-09cd2e737602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:40.664726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-20019d7d-c925-458f-92ec-09cd2e737602 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:40.665872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-20019d7d-c925-458f-92ec-09cd2e737602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:40.688760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1182/2357] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:40.693936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb0663-e921-421d-afde-b196c11333ee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:40.707710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb0663-e921-421d-afde-b196c11333ee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:40.722869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:40.723897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:40.724501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:40.724909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:40.726184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:40.730703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:40.733357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:40.762811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1176/2358] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:29:40.764044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20019d7d-c925-458f-92ec-09cd2e737602 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:40.774219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20019d7d-c925-458f-92ec-09cd2e737602 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:40.779215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:40.779898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:40.780198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:40.780444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:40.781149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:40.783107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:40.833915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1183/2359] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:40 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:40.835166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:40.861378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e3804-79cf-4517-b15c-037941c36d44 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:41.080413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:41.081137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:41.081427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:41.081700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:41.084043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:41.086254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:41.109986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:41.143844 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1177/2360] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:40 2022] POST /identity/v3/users => generated 287 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:41.145621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:41.166714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeb69b-b26d-47d8-b174-a384f05b9f64 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:41.180213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:41.181744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:41.182032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:41.182326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:41.186051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:41.190274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:41.211627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1184/2361] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:41.215291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:41.227987 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6dcd1-67aa-4c4b-818a-94a8973602f0 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:41.233781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29f53d-8b5b-49be-8be3-93ef09739a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:41.234663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f53d-8b5b-49be-8be3-93ef09739a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:41.234997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f53d-8b5b-49be-8be3-93ef09739a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:41.235261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29f53d-8b5b-49be-8be3-93ef09739a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:41.236000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29f53d-8b5b-49be-8be3-93ef09739a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:41.237692 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29f53d-8b5b-49be-8be3-93ef09739a69 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:41.256155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1178/2362] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:41.259766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:41.281443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca96964-1e02-44fa-aae3-a9bda37c77c3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:41.288087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:41.289630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:41.290041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:41.290606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] PATH_INFO: `/v3/projects/f97a3bc435fb48e8979ca0aad69520d5/users/8e58e46d54f74fe0bef1eafa934e556d/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:41.318866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97a3bc435fb48e8979ca0aad69520d5, user_id=8e58e46d54f74fe0bef1eafa934e556d, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:41.322218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:41.350370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1185/2363] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:41 2022] PUT /identity/v3/projects/f97a3bc435fb48e8979ca0aad69520d5/users/8e58e46d54f74fe0bef1eafa934e556d/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:41.429485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206e4d-c188-4993-9dea-bfc47ee6303a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:41.429736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206e4d-c188-4993-9dea-bfc47ee6303a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:41.430018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80206e4d-c188-4993-9dea-bfc47ee6303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:41.463850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-80206e4d-c188-4993-9dea-bfc47ee6303a None None] MFA Rules not processed for user `8e58e46d54f74fe0bef1eafa934e556d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:41.465135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-80206e4d-c188-4993-9dea-bfc47ee6303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:41.586712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1179/2364] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:41.603417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:41.605620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:41.715801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4183e-00b3-4e5e-9ae6-3b4d25d0a325 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:41.720559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b0c5-c113-4f10-9cbd-527f8760b50d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:41.721666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b0c5-c113-4f10-9cbd-527f8760b50d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:41.722207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b0c5-c113-4f10-9cbd-527f8760b50d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:41.722816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b0c5-c113-4f10-9cbd-527f8760b50d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:41.734940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b0c5-c113-4f10-9cbd-527f8760b50d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:41.737034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b0c5-c113-4f10-9cbd-527f8760b50d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:41.752491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1186/2365] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:41.787516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206e4d-c188-4993-9dea-bfc47ee6303a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:42.017562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80206e4d-c188-4993-9dea-bfc47ee6303a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:42.030320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:42.031228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:42.031514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:42.031792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] PATH_INFO: `/v3/users/8e58e46d54f74fe0bef1eafa934e556d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:42.033102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e58e46d54f74fe0bef1eafa934e556d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:42.035114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:42.139812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e58e46d54f74fe0bef1eafa934e556d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:42.140637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e58e46d54f74fe0bef1eafa934e556d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:42.143137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e58e46d54f74fe0bef1eafa934e556d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:42.163215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e58e46d54f74fe0bef1eafa934e556d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:42.191985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e58e46d54f74fe0bef1eafa934e556d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:42.195412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:42.233496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1180/2366] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:41 2022] DELETE /identity/v3/users/8e58e46d54f74fe0bef1eafa934e556d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:29:42.246969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:42.247566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:42.247566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:42.291875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:42.293361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:42.335932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:42.542178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1187/2367] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:42.554483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:42.556110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:42.718668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd151dd-de62-40d2-b439-aa3c04994c6e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:42.739033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:42.739976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:42.740547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:42.740836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:42.770714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:42.774722 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:42.825119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1181/2368] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:43.634434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:43.636215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:43.664210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ee54e-122b-4030-b0a0-80f2ddeece92 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:43.680903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:43.683343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:43.683631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:43.683899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] PATH_INFO: `/v3/projects/f97a3bc435fb48e8979ca0aad69520d5` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:43.693834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97a3bc435fb48e8979ca0aad69520d5)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:43.695863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:43.889352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97a3bc435fb48e8979ca0aad69520d5', 'request_id': 'req-127c7ae5-d86c-4869-af1d-39d91ea5bad2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:43.915093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97a3bc435fb48e8979ca0aad69520d5', 'request_id': 'req-127c7ae5-d86c-4869-af1d-39d91ea5bad2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:43.941573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97a3bc435fb48e8979ca0aad69520d5', 'request_id': 'req-127c7ae5-d86c-4869-af1d-39d91ea5bad2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:43.993106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] The token cache is being invalidate because project f97a3bc435fb48e8979ca0aad69520d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:43.993399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:43.996823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-127c7ae5-d86c-4869-af1d-39d91ea5bad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:43.999133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1188/2369] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:43 2022] DELETE /identity/v3/projects/f97a3bc435fb48e8979ca0aad69520d5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:47.169035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:47.170776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:47.244837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb26d0e-f860-4107-ba36-90d6e2a6fa06 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:47.301270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:47.303679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:47.303679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:47.303679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:47.307218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:47.390315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:47.391993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:47.405018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1182/2370] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:47.568655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c143c-173b-4fbe-8b94-86eec63af872 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:47.569222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c143c-173b-4fbe-8b94-86eec63af872 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:47.569222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c143c-173b-4fbe-8b94-86eec63af872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:47.604431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2c8c143c-173b-4fbe-8b94-86eec63af872 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:47.605765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2c8c143c-173b-4fbe-8b94-86eec63af872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:47.710615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1189/2371] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:29:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:47.725508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:47.728026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:47.744150 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:47.850119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5063b-127f-44fa-b3e5-11033c6a6a8c service glance] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:47.859890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:47.859890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:47.859890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:47.859890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:47.870445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:47.872072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:47.881114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1183/2372] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:29:48.392227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:48.392518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:48.392809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:48.438605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:48.440337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:48.452595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1190/2373] 10.222.0.50 () {58 vars in 967 bytes} [Tue Jul 12 17:29:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:48.482428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:48.506382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f705666-2a34-4d03-a071-fc9de0e13f4c service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:48.532400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:48.535708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:48.536079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:48.536902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:48.554199 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:48.556047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:48.587561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1184/2374] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:29:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:29:51.344335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:51.347428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:51.425783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:51.468238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3a9cc-6042-47f6-96c6-ffcd3aac66fc None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:51.476422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:51.478191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:51.478191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:51.478191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] PATH_INFO: `/v3/users/5bcb1bb8462249e1a2d8acf0f7e08b27` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:51.479586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcb1bb8462249e1a2d8acf0f7e08b27)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:51.482582 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:51.547901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcb1bb8462249e1a2d8acf0f7e08b27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:51.560335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcb1bb8462249e1a2d8acf0f7e08b27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:51.579541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcb1bb8462249e1a2d8acf0f7e08b27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:51.587545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcb1bb8462249e1a2d8acf0f7e08b27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:51.588912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcb1bb8462249e1a2d8acf0f7e08b27'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:51.597286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1191/2375] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:51 2022] DELETE /identity/v3/users/5bcb1bb8462249e1a2d8acf0f7e08b27 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:51.914073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:51.916035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:51.951830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a50c7-747d-4d43-a6c2-48520d88810e service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:51.984215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:51.985714 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:52.083017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:52.085541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.086099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.086576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] PATH_INFO: `/v3/users/370dec10c5b0431cab98209cd4491941` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.088825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370dec10c5b0431cab98209cd4491941)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:52.091041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:52.165938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370dec10c5b0431cab98209cd4491941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.167199 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370dec10c5b0431cab98209cd4491941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.168249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370dec10c5b0431cab98209cd4491941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.177882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370dec10c5b0431cab98209cd4491941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.190280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee9b0-2b17-4007-939c-d2c216237248 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:52.200282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-08a278e6-c842-4a7c-bc3d-acb596a429b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370dec10c5b0431cab98209cd4491941'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.200674 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:52.201807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.202602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.203075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] PATH_INFO: `/v3/projects/3dd7a0c1dece4ce3834cd57e22e347a6` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.205681 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd7a0c1dece4ce3834cd57e22e347a6)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:52.208025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:52.228600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1185/2376] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:51 2022] DELETE /identity/v3/users/370dec10c5b0431cab98209cd4491941 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:52.235807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.236727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.237159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.249049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:52.272305 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:52.274110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:52.338626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd7a0c1dece4ce3834cd57e22e347a6', 'request_id': 'req-850e633a-9378-40e3-97f7-09e1fd62815c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.359863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd7a0c1dece4ce3834cd57e22e347a6', 'request_id': 'req-850e633a-9378-40e3-97f7-09e1fd62815c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.361620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:52.374973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd7a0c1dece4ce3834cd57e22e347a6', 'request_id': 'req-850e633a-9378-40e3-97f7-09e1fd62815c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.390310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1186/2377] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:52.404291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:52.408646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:52.409899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] The token cache is being invalidate because project 3dd7a0c1dece4ce3834cd57e22e347a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:52.410552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.411573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-850e633a-9378-40e3-97f7-09e1fd62815c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:52.413784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1192/2378] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:51 2022] DELETE /identity/v3/projects/3dd7a0c1dece4ce3834cd57e22e347a6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:52.423170 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ca60-1be0-434d-8aed-f23624c9e303 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.424302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ca60-1be0-434d-8aed-f23624c9e303 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.424842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0ca60-1be0-434d-8aed-f23624c9e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.481581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2cb0ca60-1be0-434d-8aed-f23624c9e303 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:52.483079 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2cb0ca60-1be0-434d-8aed-f23624c9e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:52.544926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ccbf8-2920-424b-8c1a-9ecc04b8dbf1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:52.636304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1193/2379] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:52.638447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154315b6-4b81-4c98-95a1-d2e810b67891 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.638807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154315b6-4b81-4c98-95a1-d2e810b67891 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.639150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154315b6-4b81-4c98-95a1-d2e810b67891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.694058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:52.698042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.698366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.699612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-154315b6-4b81-4c98-95a1-d2e810b67891 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:52.700047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.701010 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-154315b6-4b81-4c98-95a1-d2e810b67891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:52.706483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:52.714341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1194/2380] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:52.716236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154315b6-4b81-4c98-95a1-d2e810b67891 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:52.732323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:52.734107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:52.737742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154315b6-4b81-4c98-95a1-d2e810b67891 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:52.754114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:52.755612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.756305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.756781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.757975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:29:52.758540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:52.761076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:52.775161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1187/2381] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:52.791365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1195/2382] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:29:52.796153 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:52.817350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb3446-66f9-42af-9cc2-500dd13233ff service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:52.847618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce5b71-7a81-4f09-9712-75937c3401d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:52.850686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5b71-7a81-4f09-9712-75937c3401d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:52.856439 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5b71-7a81-4f09-9712-75937c3401d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:52.864786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce5b71-7a81-4f09-9712-75937c3401d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:52.866328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5b71-7a81-4f09-9712-75937c3401d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:52.871877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce5b71-7a81-4f09-9712-75937c3401d9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:52.927009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1188/2383] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:29:52 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:52.931468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:52.961406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443b132-70d4-442b-bb2b-dc6a86345b43 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:53.067616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9f1c4-1e4b-482f-bd1a-8b5efad0b633 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.069128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9f1c4-1e4b-482f-bd1a-8b5efad0b633 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.069513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9f1c4-1e4b-482f-bd1a-8b5efad0b633 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.071431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1189/2384] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:29:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:29:53.083621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.084972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.085375 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.144947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:53.148873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:53.179026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:53.180293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.180783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.181255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.182406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:53.184962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:53.240635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:53.253501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1196/2385] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:29:52 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:29:53.254947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:53.285612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf6a1-4b1f-454b-b5b3-59c24c341a6d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:53.297901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:53.299213 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.301418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.302015 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.303199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:53.307829 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:53.321042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1190/2386] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:53.333891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:53.335868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:53.340707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1197/2387] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:53.341433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:53.363112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0551384-28be-4c3b-8b0a-fd4fc606b0d8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:53.369085 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:53.369784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.370268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.370724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.371747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:53.373325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:53.403632 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1198/2388] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:29:53.406361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:53.408395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e92ed9-c891-45cf-bfbe-78cabe11cf41 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:53.413840 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db379ea7-7173-4578-88ba-391764b382e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:53.415153 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db379ea7-7173-4578-88ba-391764b382e5 service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.415450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db379ea7-7173-4578-88ba-391764b382e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.415723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db379ea7-7173-4578-88ba-391764b382e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.426587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7b55a-fba1-4c02-9c75-4aef821d19fc admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:53.432736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e135cbf-2890-4c4d-842e-c7cce2cb010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:53.432927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db379ea7-7173-4578-88ba-391764b382e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:53.434630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135cbf-2890-4c4d-842e-c7cce2cb010b admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.434735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db379ea7-7173-4578-88ba-391764b382e5 service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:53.434815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135cbf-2890-4c4d-842e-c7cce2cb010b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.435531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e135cbf-2890-4c4d-842e-c7cce2cb010b admin admin] PATH_INFO: `/v3/projects/b288f2f38234402abc8c93993f54808f/users/b6b25e265eab4edcaf417dc0d4376747/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.448616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1191/2389] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:53.457774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135cbf-2890-4c4d-842e-c7cce2cb010b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b288f2f38234402abc8c93993f54808f, user_id=b6b25e265eab4edcaf417dc0d4376747, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:53.461316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e135cbf-2890-4c4d-842e-c7cce2cb010b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:53.486983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1199/2390] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:29:53 2022] PUT /identity/v3/projects/b288f2f38234402abc8c93993f54808f/users/b6b25e265eab4edcaf417dc0d4376747/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:53.500583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.500876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.501136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.531215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] MFA Rules not processed for user `b6b25e265eab4edcaf417dc0d4376747`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:53.532432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:53.618740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea49a30-a466-466d-84a2-28012836c2a9 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.619157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea49a30-a466-466d-84a2-28012836c2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.619458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea49a30-a466-466d-84a2-28012836c2a9 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.623298 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1200/2391] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:29:53.623484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1192/2392] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:53.634186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.634590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.634961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.653477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:53.662952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:53.692494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] MFA Rules not processed for user `164446c4b65e4043a492dc626a571e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:53.697385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:53.714065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:53.865132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1201/2393] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:29:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:53.865897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:53.869201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:53.882525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a891dc5-1df3-4263-9790-0034b2e0c0e9 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:53.897157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:53.901264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.901564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.901880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.924121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:53.926213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:53.940873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1193/2394] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:53.941810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:53.943501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:53.966861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982940-0a09-4f88-a454-f47d1e515c2c service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:53.977367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94959da5-8635-4d3f-9b8c-2f8c9290a5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:53.978051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94959da5-8635-4d3f-9b8c-2f8c9290a5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:53.978351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94959da5-8635-4d3f-9b8c-2f8c9290a5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:53.978630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94959da5-8635-4d3f-9b8c-2f8c9290a5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:53.990426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:54.003704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94959da5-8635-4d3f-9b8c-2f8c9290a5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:54.005860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94959da5-8635-4d3f-9b8c-2f8c9290a5b5 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:54.018223 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1194/2395] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:54.062500 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42120521-353d-4b79-a1d6-b89d803afbca None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:54.076003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:54.078724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:54.081281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:54.081666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] PATH_INFO: `/v3/projects/90b47379b38a4e498c9a25bc81580cc2` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:54.085579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b47379b38a4e498c9a25bc81580cc2)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:54.091757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:54.149851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d141f-511f-4920-ae6c-be25dfc0eef1 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:54.149851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d141f-511f-4920-ae6c-be25dfc0eef1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:54.150726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d141f-511f-4920-ae6c-be25dfc0eef1 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:54.151951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1195/2396] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 17:29:54.176340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:54.176643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:54.176963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:54.222240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:54.225151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:54.249739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b47379b38a4e498c9a25bc81580cc2', 'request_id': 'req-6271bb99-4864-4088-b5ea-a5b47151a211'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:54.260703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b47379b38a4e498c9a25bc81580cc2', 'request_id': 'req-6271bb99-4864-4088-b5ea-a5b47151a211'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:54.270009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b47379b38a4e498c9a25bc81580cc2', 'request_id': 'req-6271bb99-4864-4088-b5ea-a5b47151a211'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:54.292534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] The token cache is being invalidate because project 90b47379b38a4e498c9a25bc81580cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:54.292885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:54.294114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:54.315700 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1202/2397] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:53 2022] DELETE /identity/v3/projects/90b47379b38a4e498c9a25bc81580cc2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:54.355663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1196/2398] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:29:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:54.368082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:54.369558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:54.564190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:54.579539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271bb99-4864-4088-b5ea-a5b47151a211 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:54.602724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad47b-d66d-46e6-8e03-c5c70cf51ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:54.603820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad47b-d66d-46e6-8e03-c5c70cf51ead service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:54.604296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad47b-d66d-46e6-8e03-c5c70cf51ead service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:54.605617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad47b-d66d-46e6-8e03-c5c70cf51ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:54.634671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad47b-d66d-46e6-8e03-c5c70cf51ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:54.636907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad47b-d66d-46e6-8e03-c5c70cf51ead service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:54.690920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1203/2399] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:56.994765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:56.996316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:57.087441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ce7ee-2549-4d9a-8c1a-d1859dbe783d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:57.092603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:57.093647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:57.094029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:57.094445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] PATH_INFO: `/v3/users/b6b25e265eab4edcaf417dc0d4376747` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:57.095757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b25e265eab4edcaf417dc0d4376747)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:57.097829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:57.156823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b25e265eab4edcaf417dc0d4376747'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:57.157645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b25e265eab4edcaf417dc0d4376747'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:57.158359 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b25e265eab4edcaf417dc0d4376747'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:57.168721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b25e265eab4edcaf417dc0d4376747'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:57.189587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b25e265eab4edcaf417dc0d4376747'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:57.210998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1197/2400] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:29:56 2022] DELETE /identity/v3/users/b6b25e265eab4edcaf417dc0d4376747 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:57.216427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:57.216427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:57.216427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:57.236201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:57.237446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:57.309942 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1204/2401] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:29:57.323527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:57.325280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:57.334690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:29:57.457054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9f681-60c9-425e-8029-71acdb3951b7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:57.464053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd2716-fc2f-4e2a-8a34-9157a68fed20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:57.464751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2716-fc2f-4e2a-8a34-9157a68fed20 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:57.465109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2716-fc2f-4e2a-8a34-9157a68fed20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:57.465948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2716-fc2f-4e2a-8a34-9157a68fed20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:57.485045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd2716-fc2f-4e2a-8a34-9157a68fed20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:57.486236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd2716-fc2f-4e2a-8a34-9157a68fed20 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:57.504623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1198/2402] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:29:57.895611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:57.897609 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:57.912623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b96d7-2773-42eb-b75c-849a6947cd25 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:57.918570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:57.919454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:57.919754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:57.920057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] PATH_INFO: `/v3/projects/b288f2f38234402abc8c93993f54808f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:57.921270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b288f2f38234402abc8c93993f54808f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:57.928051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:57.993331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b288f2f38234402abc8c93993f54808f', 'request_id': 'req-878b967e-ed37-40f6-8575-fc879b2df6b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:58.008018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b288f2f38234402abc8c93993f54808f', 'request_id': 'req-878b967e-ed37-40f6-8575-fc879b2df6b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:58.014686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b288f2f38234402abc8c93993f54808f', 'request_id': 'req-878b967e-ed37-40f6-8575-fc879b2df6b4'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:58.030400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] The token cache is being invalidate because project b288f2f38234402abc8c93993f54808f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:29:58.030779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:58.036158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:29:58.039893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1205/2403] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:29:57 2022] DELETE /identity/v3/projects/b288f2f38234402abc8c93993f54808f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:29:58.542832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2e7b-4492-4f51-8e9d-fcaa2e1ca0ab None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:58.543381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2e7b-4492-4f51-8e9d-fcaa2e1ca0ab None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:58.543641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e2e7b-4492-4f51-8e9d-fcaa2e1ca0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:58.564884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0b8e2e7b-4492-4f51-8e9d-fcaa2e1ca0ab None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:29:58.566235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0b8e2e7b-4492-4f51-8e9d-fcaa2e1ca0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:58.668196 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1199/2404] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:29:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:29:58.682368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:29:58.684356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:29:58.799836 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b967e-ed37-40f6-8575-fc879b2df6b4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:29:58.805698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541fb4e-0ac3-4981-b59a-4b83084a59f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:29:58.806476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541fb4e-0ac3-4981-b59a-4b83084a59f8 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:29:58.806855 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541fb4e-0ac3-4981-b59a-4b83084a59f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:29:58.807205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541fb4e-0ac3-4981-b59a-4b83084a59f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:29:58.816824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541fb4e-0ac3-4981-b59a-4b83084a59f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:29:58.819486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541fb4e-0ac3-4981-b59a-4b83084a59f8 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:29:58.829115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1206/2405] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:30:00.004000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a908190-174b-4b52-a9e3-f705a614ef76 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:30:00.004551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a908190-174b-4b52-a9e3-f705a614ef76 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:30:00.004551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a908190-174b-4b52-a9e3-f705a614ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:30:00.047928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-3a908190-174b-4b52-a9e3-f705a614ef76 None None] MFA Rules not processed for user `8dd3035ec54f49f4ba0aec447532f7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:30:00.049342 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3a908190-174b-4b52-a9e3-f705a614ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:30:00.112901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1200/2406] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:30:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:30:08.825273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:10.106103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=74 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:12.935507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf6dd-9335-475e-b2ce-1820f145e157 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:30:12.936029 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf6dd-9335-475e-b2ce-1820f145e157 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:30:12.936132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf6dd-9335-475e-b2ce-1820f145e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:30:12.954506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-7c1cf6dd-9335-475e-b2ce-1820f145e157 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:30:12.955656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7c1cf6dd-9335-475e-b2ce-1820f145e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:30:12.963823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1207/2407] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:30:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:30:12.990078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a908190-174b-4b52-a9e3-f705a614ef76 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:30:13.002749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a908190-174b-4b52-a9e3-f705a614ef76 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:30:13.012361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:30:13.013242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:30:13.013550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:30:13.013816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:30:13.026985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:30:13.028926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:30:13.044037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1201/2408] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:30:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:30:22.951005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:23.036813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:24.130656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:30:24.131142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:30:24.131246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:30:24.149701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:30:24.151291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:30:24.159403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1208/2409] 10.222.0.50 () {58 vars in 967 bytes} [Tue Jul 12 17:30:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:30:24.171967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:30:24.183115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d86ea6-9bef-4384-8a48-1ce34d5fe743 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:30:24.188553 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f08131-ac12-450c-885c-9a668854bb5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:30:24.189188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08131-ac12-450c-885c-9a668854bb5d service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:30:24.189455 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08131-ac12-450c-885c-9a668854bb5d service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:30:24.189747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f08131-ac12-450c-885c-9a668854bb5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:30:24.199227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f08131-ac12-450c-885c-9a668854bb5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:30:24.200812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f08131-ac12-450c-885c-9a668854bb5d service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:30:24.209045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1202/2410] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:30:34.144305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:34.205849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:30:34.863349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:30:34.864756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:30:34.920321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4809c-8200-4680-9b4b-034f0ecab88d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:30:34.923994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:30:34.924712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:30:34.925030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:30:34.925257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:30:34.927088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:30:34.987650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:30:34.989098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:30:34.999411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1209/2411] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:30:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:30:44.994624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=50 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:09.329311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d2b1-671a-4e7e-9d13-eb42aad17089 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:31:09.330509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d2b1-671a-4e7e-9d13-eb42aad17089 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:31:09.330509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d2b1-671a-4e7e-9d13-eb42aad17089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:31:09.348237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a731d2b1-671a-4e7e-9d13-eb42aad17089 None None] MFA Rules not processed for user `58298868d67d4aa584a9fed53e4358a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:31:09.349457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a731d2b1-671a-4e7e-9d13-eb42aad17089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:31:09.407658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1203/2412] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:31:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:31:10.322957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:31:10.324387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:31:10.410878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133ca06-b94c-4315-a1f3-a27b4d84480e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:31:10.416148 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eff4a-5368-4d07-8327-aacbc7674985 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:31:10.416810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eff4a-5368-4d07-8327-aacbc7674985 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:31:10.417093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eff4a-5368-4d07-8327-aacbc7674985 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:31:10.417368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eff4a-5368-4d07-8327-aacbc7674985 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:31:10.419159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-306eff4a-5368-4d07-8327-aacbc7674985 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:31:10.431879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eff4a-5368-4d07-8327-aacbc7674985 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:31:10.433496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eff4a-5368-4d07-8327-aacbc7674985 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:31:10.454934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1210/2413] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:31:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:31:17.422244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66792ec-1143-4a5a-b5b2-60427e0d4fee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:31:17.422828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66792ec-1143-4a5a-b5b2-60427e0d4fee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:31:17.422828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66792ec-1143-4a5a-b5b2-60427e0d4fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:31:17.441798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c66792ec-1143-4a5a-b5b2-60427e0d4fee None None] MFA Rules not processed for user `7e5a33e74f604488b83efeec71ca7981`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:31:17.443112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c66792ec-1143-4a5a-b5b2-60427e0d4fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:31:17.505083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1204/2414] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:31:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:31:20.446751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=32 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:27.497693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=50 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:31:27.905839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1f8b-80c2-42c7-8d67-c097e73060be None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:31:27.906753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1f8b-80c2-42c7-8d67-c097e73060be None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:31:27.907044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b1f8b-80c2-42c7-8d67-c097e73060be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:31:27.925275 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fb5b1f8b-80c2-42c7-8d67-c097e73060be None None] MFA Rules not processed for user `190092274f6843959bf16a569a388ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:31:27.926511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fb5b1f8b-80c2-42c7-8d67-c097e73060be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:31:27.987566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1211/2415] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:31:37.979470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=25 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:08.538663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66792ec-1143-4a5a-b5b2-60427e0d4fee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:08.549188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66792ec-1143-4a5a-b5b2-60427e0d4fee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:08.553365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba894c-03b3-4d88-a3b9-1d12d465ca22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:08.554019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba894c-03b3-4d88-a3b9-1d12d465ca22 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:08.554308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba894c-03b3-4d88-a3b9-1d12d465ca22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:08.554600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba894c-03b3-4d88-a3b9-1d12d465ca22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:08.556514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-89ba894c-03b3-4d88-a3b9-1d12d465ca22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:08.629396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba894c-03b3-4d88-a3b9-1d12d465ca22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:08.630900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba894c-03b3-4d88-a3b9-1d12d465ca22 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:08.641173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1205/2416] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:12.135060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73d5bc-8725-4202-b123-fcdc4538cdc4 None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.135649 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73d5bc-8725-4202-b123-fcdc4538cdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.135755 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73d5bc-8725-4202-b123-fcdc4538cdc4 None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.137193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1212/2417] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:32:12.142528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.143330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.143606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.162192 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] MFA Rules not processed for user `76f25ce386864d6f9090154cb210807a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:12.163535 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:12.172517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1206/2418] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:32:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:12.188234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73d5bc-8725-4202-b123-fcdc4538cdc4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:12.205336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73d5bc-8725-4202-b123-fcdc4538cdc4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:12.211804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:12.212587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.212927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.213234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.214925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:12.216528 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:12.223547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:12.225122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:12.233131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79cabc-25b8-4274-a14e-3392ad3ddcb7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:12.236053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1213/2419] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:12.241089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:12.241989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.242272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.242579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] PATH_INFO: `/v3/users/58298868d67d4aa584a9fed53e4358a2` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.243842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58298868d67d4aa584a9fed53e4358a2)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:12.245800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:12.297778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58298868d67d4aa584a9fed53e4358a2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.298475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58298868d67d4aa584a9fed53e4358a2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.299158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58298868d67d4aa584a9fed53e4358a2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.307496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58298868d67d4aa584a9fed53e4358a2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.322951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7e5a363c-4e00-47bb-9348-932525c39261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58298868d67d4aa584a9fed53e4358a2'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.338525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1207/2420] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:12 2022] DELETE /identity/v3/users/58298868d67d4aa584a9fed53e4358a2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:32:12.528450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:12.545969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7b232-5481-4246-9a54-fcea011ee09b service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:12.610657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:12.611533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.611823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.612100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] PATH_INFO: `/v3/projects/5e4579e62fe946c0848d19f6e00047a4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.613338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e4579e62fe946c0848d19f6e00047a4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:12.615328 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:12.667685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e4579e62fe946c0848d19f6e00047a4', 'request_id': 'req-3de81e26-f27a-4f23-8fd7-260314348884'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.676015 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e4579e62fe946c0848d19f6e00047a4', 'request_id': 'req-3de81e26-f27a-4f23-8fd7-260314348884'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.681558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e4579e62fe946c0848d19f6e00047a4', 'request_id': 'req-3de81e26-f27a-4f23-8fd7-260314348884'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.692845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] The token cache is being invalidate because project 5e4579e62fe946c0848d19f6e00047a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:12.693131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.693969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3de81e26-f27a-4f23-8fd7-260314348884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:12.695690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1214/2421] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:12 2022] DELETE /identity/v3/projects/5e4579e62fe946c0848d19f6e00047a4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:12.706947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989317b0-229f-41b9-8225-34ea825d14b6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.707238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989317b0-229f-41b9-8225-34ea825d14b6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.707529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989317b0-229f-41b9-8225-34ea825d14b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.727600 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-989317b0-229f-41b9-8225-34ea825d14b6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:12.728813 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-989317b0-229f-41b9-8225-34ea825d14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:12.784493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:12.795721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1208/2422] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:12.803546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd379-3e3b-4be9-9596-3b7a8022ed10 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.803769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd379-3e3b-4be9-9596-3b7a8022ed10 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.804057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cd379-3e3b-4be9-9596-3b7a8022ed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.824004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-2d0cd379-3e3b-4be9-9596-3b7a8022ed10 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:12.825217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2d0cd379-3e3b-4be9-9596-3b7a8022ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:12.835071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1215/2423] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:12.840130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989317b0-229f-41b9-8225-34ea825d14b6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:12.853796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989317b0-229f-41b9-8225-34ea825d14b6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:12.860049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:12.860721 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.860997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.861264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.861959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:12.862718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:12.863914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:12.876491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1209/2424] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:32:12.881021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd379-3e3b-4be9-9596-3b7a8022ed10 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:12.890522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cd379-3e3b-4be9-9596-3b7a8022ed10 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:12.895556 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:12.896200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:12.896477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:12.896746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:12.897463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:12.899422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:12.927769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1216/2425] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:12 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:12.932032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:12.942805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eb6f0-ed0d-4449-a324-19f8754b84fe admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:13.002137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:13.002849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:13.003129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:13.003404 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:13.004102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:13.006071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:13.028669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1210/2426] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:12 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:13.033131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:13.043993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6505d-c3aa-4ffa-b6cf-a23364f69249 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:13.049477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:13.050132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:13.050422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:13.050697 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:13.051426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:13.053044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:13.064341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1217/2427] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:13.068451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:13.078993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc88bb8-6103-480d-9d55-be0caea6a1b8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:13.084399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fff10-54b2-4d8b-a814-53d6ce15e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:13.085098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fff10-54b2-4d8b-a814-53d6ce15e789 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:13.085380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fff10-54b2-4d8b-a814-53d6ce15e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:13.085673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fff10-54b2-4d8b-a814-53d6ce15e789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:13.086461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fff10-54b2-4d8b-a814-53d6ce15e789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:13.088072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fff10-54b2-4d8b-a814-53d6ce15e789 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:13.098519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1211/2428] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:13.102574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:13.113050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b1659-f58d-4b1e-9da0-0a095b200875 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:13.117683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:13.118602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:13.118884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:13.119156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] PATH_INFO: `/v3/projects/2f835d1cd49141faa4756c22cf5c996a/users/2963f35733ec4f68b45600e52fba1c85/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:13.134141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f835d1cd49141faa4756c22cf5c996a, user_id=2963f35733ec4f68b45600e52fba1c85, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:13.136853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:13.152101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1218/2429] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:13 2022] PUT /identity/v3/projects/2f835d1cd49141faa4756c22cf5c996a/users/2963f35733ec4f68b45600e52fba1c85/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:13.157543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0043-4060-4ea9-a2f3-e45f53196437 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:13.158034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0043-4060-4ea9-a2f3-e45f53196437 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:13.158133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0043-4060-4ea9-a2f3-e45f53196437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:13.176621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f5c0043-4060-4ea9-a2f3-e45f53196437 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:13.177842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f5c0043-4060-4ea9-a2f3-e45f53196437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:13.239502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1212/2430] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:13.250171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:13.252286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:13.267723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:13.317286 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec8e3-ef7c-4e0c-b718-cfeae244f628 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:13.321202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:13.321939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:13.322225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:13.322534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:13.332319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:13.333763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:13.343344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1219/2431] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:32:14.015322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fb589-8fbc-4e6c-bc6f-ae93ebdbadc7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:14.015612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fb589-8fbc-4e6c-bc6f-ae93ebdbadc7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:14.015892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fb589-8fbc-4e6c-bc6f-ae93ebdbadc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:14.044091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7f4fb589-8fbc-4e6c-bc6f-ae93ebdbadc7 None None] MFA Rules not processed for user `2963f35733ec4f68b45600e52fba1c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:14.045321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7f4fb589-8fbc-4e6c-bc6f-ae93ebdbadc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:14.106091 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:14.118577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1213/2432] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:14.124087 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:14.134976 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b1840-c3a2-414b-949b-7940f55a68c6 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:14.140050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:14.140812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:14.141092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:14.141368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:14.142069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:14.144053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:14.173684 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1220/2433] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:14 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:14.177710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fb589-8fbc-4e6c-bc6f-ae93ebdbadc7 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:14.190008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fb589-8fbc-4e6c-bc6f-ae93ebdbadc7 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:14.254814 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:14.255520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:14.255799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:14.256071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:14.256789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:14.258953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:14.284211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1214/2434] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:14 2022] POST /identity/v3/users => generated 308 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:14.285863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:14.298750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863d63e-578d-4898-80c5-793255c46338 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:14.304209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:14.304861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:14.305323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:14.305591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:14.306402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:14.308034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:14.321954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1221/2435] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:14.326551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:14.337680 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf253e5f-1032-4064-9b07-ecf925b9148b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:14.343322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:14.344255 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:14.344534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:14.344808 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] PATH_INFO: `/v3/projects/c13208805bd6467cb4d1e2970d74c667/users/454cdb5af6544828b4489105f25d4c4c/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:14.361583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13208805bd6467cb4d1e2970d74c667, user_id=454cdb5af6544828b4489105f25d4c4c, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:14.364309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:14.378065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1215/2436] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:14 2022] PUT /identity/v3/projects/c13208805bd6467cb4d1e2970d74c667/users/454cdb5af6544828b4489105f25d4c4c/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:32:14.382080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:14.392392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c356ae-b853-42a2-b491-003d94d5b26f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:14.454973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0587c1-0c96-4dab-8131-cf51c5f2ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:14.455658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0587c1-0c96-4dab-8131-cf51c5f2ef15 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:14.455939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0587c1-0c96-4dab-8131-cf51c5f2ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:14.456206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0587c1-0c96-4dab-8131-cf51c5f2ef15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:14.456931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0587c1-0c96-4dab-8131-cf51c5f2ef15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:14.458644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0587c1-0c96-4dab-8131-cf51c5f2ef15 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:14.469662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1222/2437] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:14.474219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:14.485533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b2aef-ffef-497c-bba1-428426309294 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:14.492443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:14.493714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:14.494046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:14.494448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] PATH_INFO: `/v3/projects/c13208805bd6467cb4d1e2970d74c667/users/454cdb5af6544828b4489105f25d4c4c/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:14.497414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13208805bd6467cb4d1e2970d74c667, user_id=454cdb5af6544828b4489105f25d4c4c, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:14.500504 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:14.511608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1216/2438] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:14 2022] PUT /identity/v3/projects/c13208805bd6467cb4d1e2970d74c667/users/454cdb5af6544828b4489105f25d4c4c/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:32:15.128224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729a818-0647-49e0-b054-ea4542b313f5 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:15.128523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729a818-0647-49e0-b054-ea4542b313f5 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:15.128834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729a818-0647-49e0-b054-ea4542b313f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:15.155831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a729a818-0647-49e0-b054-ea4542b313f5 None None] MFA Rules not processed for user `454cdb5af6544828b4489105f25d4c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:15.157066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a729a818-0647-49e0-b054-ea4542b313f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:15.228834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1223/2439] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:15.587320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:15.589618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:15.680817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a070a-0e10-4e8a-8f0e-fc0fe0639009 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:15.685241 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:15.685989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:15.686443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:15.687031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:15.689179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:15.752651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:15.769566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:15.771072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:15.782321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1217/2440] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:16.428352 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729a818-0647-49e0-b054-ea4542b313f5 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:16.434705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:16.543766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729a818-0647-49e0-b054-ea4542b313f5 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:16.559027 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:16.560696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:16.561555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:16.562244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] PATH_INFO: `/v3/users/2963f35733ec4f68b45600e52fba1c85` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:16.565625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2963f35733ec4f68b45600e52fba1c85)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:16.568138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:16.657484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2963f35733ec4f68b45600e52fba1c85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:16.670742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2963f35733ec4f68b45600e52fba1c85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:16.707606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2963f35733ec4f68b45600e52fba1c85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:16.720018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2963f35733ec4f68b45600e52fba1c85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:16.720860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2963f35733ec4f68b45600e52fba1c85'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:16.732302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1224/2441] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:16 2022] DELETE /identity/v3/users/2963f35733ec4f68b45600e52fba1c85 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:16.921947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:16.933638 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ea2c7-4679-479a-bad8-dd833dd707e3 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:17.012046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:17.012974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.013281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.013558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] PATH_INFO: `/v3/projects/2f835d1cd49141faa4756c22cf5c996a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.015463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f835d1cd49141faa4756c22cf5c996a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:17.017571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:17.073377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f835d1cd49141faa4756c22cf5c996a', 'request_id': 'req-6efc82c4-c484-465b-814c-b8bf5c286b7b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.079633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f835d1cd49141faa4756c22cf5c996a', 'request_id': 'req-6efc82c4-c484-465b-814c-b8bf5c286b7b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.086207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f835d1cd49141faa4756c22cf5c996a', 'request_id': 'req-6efc82c4-c484-465b-814c-b8bf5c286b7b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.100666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] The token cache is being invalidate because project 2f835d1cd49141faa4756c22cf5c996a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:17.100881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.101512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.107038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1218/2442] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:16 2022] DELETE /identity/v3/projects/2f835d1cd49141faa4756c22cf5c996a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:32:17.108490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:17.110172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:17.124224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482ec2-b034-43a9-80f4-4c4cd0794d36 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:17.183112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:17.184188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.184571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.184947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] PATH_INFO: `/v3/users/454cdb5af6544828b4489105f25d4c4c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.186344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454cdb5af6544828b4489105f25d4c4c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:17.188440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:17.219511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:17.241886 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454cdb5af6544828b4489105f25d4c4c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.249760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454cdb5af6544828b4489105f25d4c4c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.264765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454cdb5af6544828b4489105f25d4c4c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.271771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454cdb5af6544828b4489105f25d4c4c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.272481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454cdb5af6544828b4489105f25d4c4c'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.278747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1225/2443] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:17 2022] DELETE /identity/v3/users/454cdb5af6544828b4489105f25d4c4c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:17.482405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:17.485559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:17.528239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc82c4-c484-465b-814c-b8bf5c286b7b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:17.606106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:17.607437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.607741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.608345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] PATH_INFO: `/v3/projects/c13208805bd6467cb4d1e2970d74c667` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.611081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13208805bd6467cb4d1e2970d74c667)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:17.613288 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:17.641010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:17.683608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13208805bd6467cb4d1e2970d74c667', 'request_id': 'req-87d8184f-ee42-497a-be30-eaa1c49e9ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.690961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13208805bd6467cb4d1e2970d74c667', 'request_id': 'req-87d8184f-ee42-497a-be30-eaa1c49e9ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.701267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13208805bd6467cb4d1e2970d74c667', 'request_id': 'req-87d8184f-ee42-497a-be30-eaa1c49e9ab5'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.713504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:17.716336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:17.722412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] The token cache is being invalidate because project c13208805bd6467cb4d1e2970d74c667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:17.722798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.723401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-87d8184f-ee42-497a-be30-eaa1c49e9ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:17.725362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1219/2444] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:17 2022] DELETE /identity/v3/projects/c13208805bd6467cb4d1e2970d74c667 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:17.730700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63783ec-5c38-434f-92a9-bce274aeb2e8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.730998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63783ec-5c38-434f-92a9-bce274aeb2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.731306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63783ec-5c38-434f-92a9-bce274aeb2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.754213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c63783ec-5c38-434f-92a9-bce274aeb2e8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:17.755569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c63783ec-5c38-434f-92a9-bce274aeb2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:17.791939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3331f8c-e108-4412-9b0f-41e56c16c8a5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:17.837928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1220/2445] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:17.845937 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4df95-7bd4-4d1e-bbb8-0c263ebed93a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.846532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4df95-7bd4-4d1e-bbb8-0c263ebed93a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.846817 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4df95-7bd4-4d1e-bbb8-0c263ebed93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.848971 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:17.849630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.849911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.850185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.851986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:17.867533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-03f4df95-7bd4-4d1e-bbb8-0c263ebed93a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:17.868643 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-03f4df95-7bd4-4d1e-bbb8-0c263ebed93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:17.880783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1221/2446] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:17.881805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4df95-7bd4-4d1e-bbb8-0c263ebed93a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:17.892972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4df95-7bd4-4d1e-bbb8-0c263ebed93a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:17.897714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:17.898417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.898701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.898989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.899700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:17.900009 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:17.901635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:17.913901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1222/2447] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:32:17.918115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:17.929748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec347a6c-f7b0-4833-ad36-0e1f6001c6a9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:17.934821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:17.935475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:17.935758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:17.936028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:17.937105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:17.938028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:17.939055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:17.939509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:17.945795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:17.953635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1226/2448] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:32:17.967819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1223/2449] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:17 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:17.971910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:17.985667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb59c54-c772-46a3-9de1-18f2070aa13e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.054973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.055757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.056105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.056446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.057330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.060539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.086069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1227/2450] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:17 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:18.090071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.100720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c0d5c-8c80-4e2a-b0da-78a79f058993 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.105986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.106712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.106998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.107276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.108246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.110046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.124691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1224/2451] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:18.128916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.142308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e2ef-ceef-45ab-a77c-8af6999e15f3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.147129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad892c1-9482-40cf-b831-bf7388e083f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.150590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad892c1-9482-40cf-b831-bf7388e083f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.150590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad892c1-9482-40cf-b831-bf7388e083f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.150590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad892c1-9482-40cf-b831-bf7388e083f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.150590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad892c1-9482-40cf-b831-bf7388e083f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.151109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad892c1-9482-40cf-b831-bf7388e083f4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.162938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1228/2452] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:18.167168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.178875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3e562-e4f5-4945-bfc7-6660cd446e20 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.183891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.184803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.185258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.185538 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] PATH_INFO: `/v3/projects/dad04056334d47898784888bfacb011a/users/ab5566e662124258b8eed3c2e4d45d45/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.202232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad04056334d47898784888bfacb011a, user_id=ab5566e662124258b8eed3c2e4d45d45, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.205056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.220457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1225/2453] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:18 2022] PUT /identity/v3/projects/dad04056334d47898784888bfacb011a/users/ab5566e662124258b8eed3c2e4d45d45/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:18.232437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8ba3-f854-4d37-ade5-f2bdcea7ae99 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.232437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8ba3-f854-4d37-ade5-f2bdcea7ae99 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.232724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac8ba3-f854-4d37-ade5-f2bdcea7ae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.260333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b4ac8ba3-f854-4d37-ade5-f2bdcea7ae99 None None] MFA Rules not processed for user `ab5566e662124258b8eed3c2e4d45d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:18.261720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b4ac8ba3-f854-4d37-ade5-f2bdcea7ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:18.333377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1229/2454] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:18.338188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.388890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:18.433410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a837fa-1b54-474b-955d-9bb644195e10 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.441903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.442639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.442923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.443805 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.444569 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.447035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.480348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1226/2455] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:18 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:18.484299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac8ba3-f854-4d37-ade5-f2bdcea7ae99 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.495410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac8ba3-f854-4d37-ade5-f2bdcea7ae99 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.577229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.578088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.578394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.578669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.579394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.581342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.599728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:18.606734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1230/2456] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:18 2022] POST /identity/v3/users => generated 302 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:18.610573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.621409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a5a11-f462-4cf4-a6eb-e423b1bf774e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.626345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.627021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.627431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.627647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.628349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.630061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.642838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1227/2457] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:18.646948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.657446 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fbfc5-674d-4e34-9c3f-a15c0346affb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.662116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.663047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.663322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.663594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] PATH_INFO: `/v3/projects/1f2bb6333b5d4167a513f87c46fd64d4/users/cde148d4f0dc4c48b2244d21496414f7/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.679486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2bb6333b5d4167a513f87c46fd64d4, user_id=cde148d4f0dc4c48b2244d21496414f7, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.682136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.696371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1231/2458] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:18 2022] PUT /identity/v3/projects/1f2bb6333b5d4167a513f87c46fd64d4/users/cde148d4f0dc4c48b2244d21496414f7/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:18.700492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.710843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e180979-62ca-4222-b09f-e648043fa759 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.769127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904d673-a397-4188-8f22-4d1d4afc4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.769815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904d673-a397-4188-8f22-4d1d4afc4e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.770093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904d673-a397-4188-8f22-4d1d4afc4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.770395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904d673-a397-4188-8f22-4d1d4afc4e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.771127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904d673-a397-4188-8f22-4d1d4afc4e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.772771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6904d673-a397-4188-8f22-4d1d4afc4e5d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.783169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1228/2459] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:18.787511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.798404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeeb07-705d-42c1-80f8-517a3b884dc9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:18.803650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:18.804588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.804867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.805139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] PATH_INFO: `/v3/projects/1f2bb6333b5d4167a513f87c46fd64d4/users/cde148d4f0dc4c48b2244d21496414f7/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.807258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2bb6333b5d4167a513f87c46fd64d4, user_id=cde148d4f0dc4c48b2244d21496414f7, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:18.809933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:18.821377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1232/2460] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:18 2022] PUT /identity/v3/projects/1f2bb6333b5d4167a513f87c46fd64d4/users/cde148d4f0dc4c48b2244d21496414f7/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:18.832203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78cfb-f099-4aff-9753-375d1bab230d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:18.832583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78cfb-f099-4aff-9753-375d1bab230d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:18.832931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe78cfb-f099-4aff-9753-375d1bab230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:18.864206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bbe78cfb-f099-4aff-9753-375d1bab230d None None] MFA Rules not processed for user `cde148d4f0dc4c48b2244d21496414f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:18.865534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bbe78cfb-f099-4aff-9753-375d1bab230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:18.955358 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1229/2461] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:18.966633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:18.968624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:19.043431 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0735a73-d737-488f-9bc9-bfbd6c4d5fd1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:19.047962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:19.048860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:19.049180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:19.049458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:19.059586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:19.061725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:19.084604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1233/2462] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:19.150198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe78cfb-f099-4aff-9753-375d1bab230d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:19.162093 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe78cfb-f099-4aff-9753-375d1bab230d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:19.166139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fabd7-c290-425e-9cca-f1c1f86b39c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:19.166942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fabd7-c290-425e-9cca-f1c1f86b39c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:19.167273 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fabd7-c290-425e-9cca-f1c1f86b39c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:19.167594 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fabd7-c290-425e-9cca-f1c1f86b39c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:19.205242 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:19.248408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fabd7-c290-425e-9cca-f1c1f86b39c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:19.249976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fabd7-c290-425e-9cca-f1c1f86b39c0 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:19.260319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1230/2463] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:32:22.634071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:22.709000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824a99c-228b-47d1-969a-f516096eaf33 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:22.713477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:22.714381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:22.714667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:22.714969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] PATH_INFO: `/v3/users/ab5566e662124258b8eed3c2e4d45d45` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:22.716313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5566e662124258b8eed3c2e4d45d45)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:22.718385 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:22.769224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5566e662124258b8eed3c2e4d45d45'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:22.778370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5566e662124258b8eed3c2e4d45d45'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:22.787849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:22.793491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5566e662124258b8eed3c2e4d45d45'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:22.801739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5566e662124258b8eed3c2e4d45d45'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:22.802504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5566e662124258b8eed3c2e4d45d45'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:22.808476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1234/2464] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:22 2022] DELETE /identity/v3/users/ab5566e662124258b8eed3c2e4d45d45 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:22.813077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:22.813554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:22.813700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:22.831300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:22.832492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:22.891363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1231/2465] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:22.903063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:22.905439 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:22.966703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9901c7-8a5b-44c6-811c-786b475da054 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:22.971251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:22.971903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:22.972229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:22.972531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:22.983387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:22.984835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:22.995698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1235/2466] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:23.355839 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:23.358003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:23.378263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554fb72-c6c9-49ef-a763-5040d7bbdfba None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:23.383685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:23.384541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:23.384953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:23.385320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] PATH_INFO: `/v3/projects/dad04056334d47898784888bfacb011a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:23.386819 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad04056334d47898784888bfacb011a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:23.389122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:23.440853 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad04056334d47898784888bfacb011a', 'request_id': 'req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.446940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad04056334d47898784888bfacb011a', 'request_id': 'req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.454598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad04056334d47898784888bfacb011a', 'request_id': 'req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.469311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] The token cache is being invalidate because project dad04056334d47898784888bfacb011a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:23.469541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.470387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.471985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1232/2467] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:23 2022] DELETE /identity/v3/projects/dad04056334d47898784888bfacb011a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:23.482023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:23.492302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d357f-4dc0-4025-876a-724aba511cb1 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:23.571008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:23.572159 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:23.572517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:23.572864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] PATH_INFO: `/v3/users/cde148d4f0dc4c48b2244d21496414f7` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:23.574266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde148d4f0dc4c48b2244d21496414f7)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:23.576380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:23.627476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde148d4f0dc4c48b2244d21496414f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.635103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde148d4f0dc4c48b2244d21496414f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.669621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde148d4f0dc4c48b2244d21496414f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.681006 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde148d4f0dc4c48b2244d21496414f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.682031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde148d4f0dc4c48b2244d21496414f7'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:23.688358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1236/2468] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:23 2022] DELETE /identity/v3/users/cde148d4f0dc4c48b2244d21496414f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:23.853711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:23.856076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:23.915417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:23.940103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e8119-ec9c-49a2-a0aa-b41b2d8a20e7 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:23.982188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:23.984526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:23.994765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:24.013720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e00ed-72ac-48a6-ae47-c7db3adb2b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.014166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e00ed-72ac-48a6-ae47-c7db3adb2b74 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.014496 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e00ed-72ac-48a6-ae47-c7db3adb2b74 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.014811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e00ed-72ac-48a6-ae47-c7db3adb2b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.016803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-282e00ed-72ac-48a6-ae47-c7db3adb2b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:24.076237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d34f2b-29e2-4552-b555-e711384cf963 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.082230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.082912 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e00ed-72ac-48a6-ae47-c7db3adb2b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.083156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.083441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.083719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] PATH_INFO: `/v3/projects/1f2bb6333b5d4167a513f87c46fd64d4` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.084970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e00ed-72ac-48a6-ae47-c7db3adb2b74 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.085100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2bb6333b5d4167a513f87c46fd64d4)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.086973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.096108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1233/2469] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:24.150539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2bb6333b5d4167a513f87c46fd64d4', 'request_id': 'req-633dc796-c1ce-45f6-8818-48966b8b4d44'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:24.160633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2bb6333b5d4167a513f87c46fd64d4', 'request_id': 'req-633dc796-c1ce-45f6-8818-48966b8b4d44'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:24.169321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2bb6333b5d4167a513f87c46fd64d4', 'request_id': 'req-633dc796-c1ce-45f6-8818-48966b8b4d44'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:24.182712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] The token cache is being invalidate because project 1f2bb6333b5d4167a513f87c46fd64d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:24.183004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:24.183919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-633dc796-c1ce-45f6-8818-48966b8b4d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:24.185777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1237/2470] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:23 2022] DELETE /identity/v3/projects/1f2bb6333b5d4167a513f87c46fd64d4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:24.190650 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4cf94-aada-4ea4-91bc-47bb44b9d8cc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.191046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4cf94-aada-4ea4-91bc-47bb44b9d8cc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.191408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4cf94-aada-4ea4-91bc-47bb44b9d8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.210432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-8ed4cf94-aada-4ea4-91bc-47bb44b9d8cc None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:24.211738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8ed4cf94-aada-4ea4-91bc-47bb44b9d8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:24.281122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1234/2471] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:24.289510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d58a2-430f-4030-8e58-cf33714b5799 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.289804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d58a2-430f-4030-8e58-cf33714b5799 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.290132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d58a2-430f-4030-8e58-cf33714b5799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.312399 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-308d58a2-430f-4030-8e58-cf33714b5799 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:24.313650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-308d58a2-430f-4030-8e58-cf33714b5799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:24.321775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1238/2472] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:24.326046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4cf94-aada-4ea4-91bc-47bb44b9d8cc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.335940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4cf94-aada-4ea4-91bc-47bb44b9d8cc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.340426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.341083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.341366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.341635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.342376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:24.342681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.344287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.357198 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1235/2473] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:32:24.362354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d58a2-430f-4030-8e58-cf33714b5799 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.372705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d58a2-430f-4030-8e58-cf33714b5799 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.378989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.379719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.380019 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.380293 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.380988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.383025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.409497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1239/2474] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:24.414190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.424826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b12f27-8f18-4fc2-8af2-7b10a0eb8445 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.433872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:24.486743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.487431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.487707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.487988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.488690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.490659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.511214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1236/2475] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:24.515527 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.526472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f20f9-3595-4576-9034-51f5dbf5b850 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.531251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.531916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.532229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.532508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.533238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.534967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.545567 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1240/2476] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:24.549603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.559823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111c6bc-ef2a-4505-8000-d569b61f3250 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.564754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997edc84-9a1b-4484-bafd-e534dc725500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.565432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997edc84-9a1b-4484-bafd-e534dc725500 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.565713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997edc84-9a1b-4484-bafd-e534dc725500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.565986 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997edc84-9a1b-4484-bafd-e534dc725500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.566746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997edc84-9a1b-4484-bafd-e534dc725500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.568343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997edc84-9a1b-4484-bafd-e534dc725500 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.583527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1237/2477] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:24.586869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.607935 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70cbce-5d8e-4668-a637-63a33cb6ce77 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.612246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23740341-fc26-4bf3-89b9-49c6d8591729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.613173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740341-fc26-4bf3-89b9-49c6d8591729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.613455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740341-fc26-4bf3-89b9-49c6d8591729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.613730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23740341-fc26-4bf3-89b9-49c6d8591729 admin admin] PATH_INFO: `/v3/projects/3bca512ca3b746da835ac1c9b058b5f6/users/a098dc8827e34c66bcd7b62fc21db5d8/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.630236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23740341-fc26-4bf3-89b9-49c6d8591729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bca512ca3b746da835ac1c9b058b5f6, user_id=a098dc8827e34c66bcd7b62fc21db5d8, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.633311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23740341-fc26-4bf3-89b9-49c6d8591729 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.647768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1241/2478] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:24 2022] PUT /identity/v3/projects/3bca512ca3b746da835ac1c9b058b5f6/users/a098dc8827e34c66bcd7b62fc21db5d8/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:24.659659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.660037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.660338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.667831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b714a8-9c64-4e78-8353-8b4e71e4632c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.668190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b714a8-9c64-4e78-8353-8b4e71e4632c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.668480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b714a8-9c64-4e78-8353-8b4e71e4632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.686774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-02b714a8-9c64-4e78-8353-8b4e71e4632c None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:24.687186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] MFA Rules not processed for user `a098dc8827e34c66bcd7b62fc21db5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:24.688260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-02b714a8-9c64-4e78-8353-8b4e71e4632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:24.689543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:24.715521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:24.747948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1242/2479] 10.222.0.50 () {58 vars in 967 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:24.756324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1238/2480] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:24.760621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b714a8-9c64-4e78-8353-8b4e71e4632c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.799062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.800571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:24.826410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b714a8-9c64-4e78-8353-8b4e71e4632c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.831199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.831864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.832139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.832413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.833080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.835031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.861279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1243/2481] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:24.865353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.874988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c0b1b-5dcc-4cf6-8b29-79a8ca82b61b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.896279 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:24.927620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722c82f-645e-4e1d-81de-5ddd86192d49 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.933291 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.933958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.934234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.934535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.935211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.937132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.939572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.940233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.940519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.940797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.956266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1244/2482] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:24 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:24.961564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:24.971998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46beadb3-91bf-44cb-ba7c-dae9f4bef953 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:24.977764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:24.978465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:24.978749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:24.979022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:24.980120 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:24.981729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:24.992634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1245/2483] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:32:24.996894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:25.000923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:25.002667 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:25.007463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12abb05-ecd8-4af0-b7a7-c2e68190b050 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:25.011120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1239/2484] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:32:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 17:32:25.013118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:25.014018 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:25.014136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:25.014539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] PATH_INFO: `/v3/projects/8f21c5d54ae743fc9a3cd1039351f9ff/users/521dc817bffe461f9e6aa93b78ad847d/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:25.030650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f21c5d54ae743fc9a3cd1039351f9ff, user_id=521dc817bffe461f9e6aa93b78ad847d, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:25.033828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:25.048225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1246/2485] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:24 2022] PUT /identity/v3/projects/8f21c5d54ae743fc9a3cd1039351f9ff/users/521dc817bffe461f9e6aa93b78ad847d/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:25.052234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:25.063559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec611d-14d6-4d61-8c3f-99f7ad4117c6 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:25.131063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a79c6-c4ea-4af8-9798-10a1426a240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:25.131753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a79c6-c4ea-4af8-9798-10a1426a240e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:25.132038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a79c6-c4ea-4af8-9798-10a1426a240e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:25.132315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a79c6-c4ea-4af8-9798-10a1426a240e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:25.133050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a79c6-c4ea-4af8-9798-10a1426a240e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:25.134740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a79c6-c4ea-4af8-9798-10a1426a240e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:25.146077 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1240/2486] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:32:25.150310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:25.161296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a7856-1333-4a96-bc2f-1453e3df545e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:25.166259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:25.167189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:25.167472 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:25.167738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] PATH_INFO: `/v3/projects/8f21c5d54ae743fc9a3cd1039351f9ff/users/521dc817bffe461f9e6aa93b78ad847d/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:25.169730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f21c5d54ae743fc9a3cd1039351f9ff, user_id=521dc817bffe461f9e6aa93b78ad847d, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:25.172551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:25.184564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1247/2487] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:25 2022] PUT /identity/v3/projects/8f21c5d54ae743fc9a3cd1039351f9ff/users/521dc817bffe461f9e6aa93b78ad847d/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:25.194823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:25.195179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:25.195484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:25.223401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] MFA Rules not processed for user `521dc817bffe461f9e6aa93b78ad847d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:25.224612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:25.276266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:25.299738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1241/2488] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:25.310438 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:25.315330 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:25.327727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:25.405413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d597c6f-f271-425d-b3e9-5ece0685d149 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:25.409259 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:25.409915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:25.410219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:25.410487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:25.470519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:25.471984 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:25.482236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1248/2489] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:25.536788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:25.538310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:25.633426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa9685-e39c-474f-a046-3c7d681fb82d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:25.640065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9f8c9-a38a-472b-8e4d-7acb05154714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:25.641057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f8c9-a38a-472b-8e4d-7acb05154714 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:25.641057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f8c9-a38a-472b-8e4d-7acb05154714 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:25.641286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f8c9-a38a-472b-8e4d-7acb05154714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:25.645103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1e9f8c9-a38a-472b-8e4d-7acb05154714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:25.710745 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9f8c9-a38a-472b-8e4d-7acb05154714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:25.712877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9f8c9-a38a-472b-8e4d-7acb05154714 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:25.725252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1242/2490] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:28.096063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:28.191881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad692ca-7ac0-490e-a1e2-38969143f410 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:28.196925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:28.197881 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:28.198163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:28.198530 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] PATH_INFO: `/v3/users/a098dc8827e34c66bcd7b62fc21db5d8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:28.199803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a098dc8827e34c66bcd7b62fc21db5d8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:28.201879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:28.263947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a098dc8827e34c66bcd7b62fc21db5d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:28.273516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a098dc8827e34c66bcd7b62fc21db5d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:28.292626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:28.306869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a098dc8827e34c66bcd7b62fc21db5d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:28.315947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a098dc8827e34c66bcd7b62fc21db5d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:28.317233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a098dc8827e34c66bcd7b62fc21db5d8'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:28.325727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1249/2491] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:28 2022] DELETE /identity/v3/users/a098dc8827e34c66bcd7b62fc21db5d8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:28.330559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:28.331140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:28.331140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:28.349661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:28.350923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:28.434679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1243/2492] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:28.442120 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:28.443588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:28.530441 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267608d5-3e88-44a1-95ac-1d10bec45302 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:28.534540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:28.535358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:28.535707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:28.536054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:28.554907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:28.560046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:28.580625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1250/2493] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:28.950427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:28.951994 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:28.968212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546bfd65-8f76-4276-8326-008f555b00d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:28.977458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:28.978770 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:28.979597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:28.979968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] PATH_INFO: `/v3/projects/3bca512ca3b746da835ac1c9b058b5f6` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:28.981972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bca512ca3b746da835ac1c9b058b5f6)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:28.984980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:29.012477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:29.047793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bca512ca3b746da835ac1c9b058b5f6', 'request_id': 'req-f745da21-801a-46fa-b666-48eb889e3802'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.055072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bca512ca3b746da835ac1c9b058b5f6', 'request_id': 'req-f745da21-801a-46fa-b666-48eb889e3802'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.061699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bca512ca3b746da835ac1c9b058b5f6', 'request_id': 'req-f745da21-801a-46fa-b666-48eb889e3802'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.075547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] The token cache is being invalidate because project 3bca512ca3b746da835ac1c9b058b5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:29.075841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.076890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.078127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1244/2494] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:28 2022] DELETE /identity/v3/projects/3bca512ca3b746da835ac1c9b058b5f6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:29.082551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:29.092193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b42838-6f02-4960-8059-27748bee65fd service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:29.156642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:29.157676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:29.158072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:29.158789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] PATH_INFO: `/v3/users/521dc817bffe461f9e6aa93b78ad847d` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:29.159908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521dc817bffe461f9e6aa93b78ad847d)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:29.161943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:29.219480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521dc817bffe461f9e6aa93b78ad847d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.230212 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521dc817bffe461f9e6aa93b78ad847d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.244074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521dc817bffe461f9e6aa93b78ad847d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.254524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521dc817bffe461f9e6aa93b78ad847d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.255266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-7ecd3e60-95a0-457c-a171-22ffdcb164c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521dc817bffe461f9e6aa93b78ad847d'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.257937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:29.266152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1251/2495] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:29 2022] DELETE /identity/v3/users/521dc817bffe461f9e6aa93b78ad847d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:32:29.747860 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:29.749432 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:29.768179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745da21-801a-46fa-b666-48eb889e3802 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:29.843489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:29.844726 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:29.845027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:29.845347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] PATH_INFO: `/v3/projects/8f21c5d54ae743fc9a3cd1039351f9ff` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:29.846768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f21c5d54ae743fc9a3cd1039351f9ff)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:29.848818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:29.905099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f21c5d54ae743fc9a3cd1039351f9ff', 'request_id': 'req-6e021ded-d7c0-47ea-8ae5-14f573df197f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.911231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f21c5d54ae743fc9a3cd1039351f9ff', 'request_id': 'req-6e021ded-d7c0-47ea-8ae5-14f573df197f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.919028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f21c5d54ae743fc9a3cd1039351f9ff', 'request_id': 'req-6e021ded-d7c0-47ea-8ae5-14f573df197f'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.934204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] The token cache is being invalidate because project 8f21c5d54ae743fc9a3cd1039351f9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:29.934542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.935176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6e021ded-d7c0-47ea-8ae5-14f573df197f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:29.937207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1245/2496] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:29 2022] DELETE /identity/v3/projects/8f21c5d54ae743fc9a3cd1039351f9ff => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:29.942453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd4e19-13fe-4222-a68a-2654e62c063d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:29.942748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd4e19-13fe-4222-a68a-2654e62c063d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:29.943030 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd4e19-13fe-4222-a68a-2654e62c063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:29.963631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-73fd4e19-13fe-4222-a68a-2654e62c063d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:29.964857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-73fd4e19-13fe-4222-a68a-2654e62c063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:30.036480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1252/2497] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:30.051406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ce5a-dd75-45bd-8d99-16cea6534a5b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.051807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ce5a-dd75-45bd-8d99-16cea6534a5b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.052212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ce5a-dd75-45bd-8d99-16cea6534a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.085698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5218ce5a-dd75-45bd-8d99-16cea6534a5b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:30.086883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5218ce5a-dd75-45bd-8d99-16cea6534a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:30.098815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1246/2498] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:30.100249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd4e19-13fe-4222-a68a-2654e62c063d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.112186 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd4e19-13fe-4222-a68a-2654e62c063d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.120533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.121434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.121553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.121763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.122742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:30.123072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.126888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.140918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1253/2499] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:32:30.145997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ce5a-dd75-45bd-8d99-16cea6534a5b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.161468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ce5a-dd75-45bd-8d99-16cea6534a5b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.174738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.175383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.175925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.176203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.177015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.179250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.225180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1247/2500] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:30 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:30.229725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.242130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7962e-dd68-46cc-8b24-9eea73f30db5 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.303204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.303920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.304205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.304479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.305169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.307168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.330509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1254/2501] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:30 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:30.334810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.346020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02653a98-14bf-4fb4-a186-6369135e0483 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.351206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.352100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.352551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.352911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.353850 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.355822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.358334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:30.371422 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1248/2502] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:30.372641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.384555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283d697-3424-48eb-9bb9-6ccd61f4369d admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.391360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c77090-2259-48d5-96c0-687e6b9e47cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.392063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77090-2259-48d5-96c0-687e6b9e47cf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.392719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77090-2259-48d5-96c0-687e6b9e47cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.393163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c77090-2259-48d5-96c0-687e6b9e47cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.395127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c77090-2259-48d5-96c0-687e6b9e47cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.395563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c77090-2259-48d5-96c0-687e6b9e47cf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.406989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1255/2503] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:30.411889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.422344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be447d-ed96-45ff-a5de-d01b2242fdb9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.427800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.428792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.429136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.429477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] PATH_INFO: `/v3/projects/d3007ab5536a41f286e4bccdc0608341/users/17fb9baa437c4922bc6385684288b2ca/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.446270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3007ab5536a41f286e4bccdc0608341, user_id=17fb9baa437c4922bc6385684288b2ca, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.449276 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.466597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1249/2504] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:30 2022] PUT /identity/v3/projects/d3007ab5536a41f286e4bccdc0608341/users/17fb9baa437c4922bc6385684288b2ca/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:30.478898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fd8e-6ac6-49af-8cfd-761557dfe087 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.479553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fd8e-6ac6-49af-8cfd-761557dfe087 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.479833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0fd8e-6ac6-49af-8cfd-761557dfe087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.513325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c6c0fd8e-6ac6-49af-8cfd-761557dfe087 None None] MFA Rules not processed for user `17fb9baa437c4922bc6385684288b2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:30.514611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c6c0fd8e-6ac6-49af-8cfd-761557dfe087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:30.577614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:30.602226 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1256/2505] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:30.607368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.672741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bbdc8-79d6-4d3b-b7a3-9095ba4a3956 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.678258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.679003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.679293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.679677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.680720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.682684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.717166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1250/2506] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:30 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:30.720483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0fd8e-6ac6-49af-8cfd-761557dfe087 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.732116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0fd8e-6ac6-49af-8cfd-761557dfe087 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.795458 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.796137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.796421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.797072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.797382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.799682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.823679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1257/2507] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:30 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:30.828430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.840110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665de886-8851-4ee6-8fc3-a4f5c7fff511 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.845663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.846386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.846829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.847103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.848020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.849647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.863332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1251/2508] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:30.867037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.880171 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25a994-bef4-4fd6-bfd8-2fdcaa5a4266 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.885533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd0d49-e7e1-466e-94e2-d28358d75f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.886565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0d49-e7e1-466e-94e2-d28358d75f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.886983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0d49-e7e1-466e-94e2-d28358d75f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.887360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd0d49-e7e1-466e-94e2-d28358d75f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.889055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0d49-e7e1-466e-94e2-d28358d75f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.890820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd0d49-e7e1-466e-94e2-d28358d75f07 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.903520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1258/2509] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:30.907818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:30.918552 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c9271-9f51-4be3-a469-a8395033103e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:30.923370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:30.924484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.924788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.925055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] PATH_INFO: `/v3/projects/775f8671a4124e45935061fe98a3b120/users/85cfb9b84f6e4288b46f9ff3c344b307/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:30.952540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775f8671a4124e45935061fe98a3b120, user_id=85cfb9b84f6e4288b46f9ff3c344b307, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:30.956875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:30.974148 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1252/2510] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:30 2022] PUT /identity/v3/projects/775f8671a4124e45935061fe98a3b120/users/85cfb9b84f6e4288b46f9ff3c344b307/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:30.985365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab81e-f7fa-495d-a036-f26e1a52e973 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:30.986261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab81e-f7fa-495d-a036-f26e1a52e973 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:30.986612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ab81e-f7fa-495d-a036-f26e1a52e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.028793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-477ab81e-f7fa-495d-a036-f26e1a52e973 None None] MFA Rules not processed for user `85cfb9b84f6e4288b46f9ff3c344b307`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:31.030178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-477ab81e-f7fa-495d-a036-f26e1a52e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:31.115199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1259/2511] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:31.117592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:31.348167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b167-d146-4cb6-9d97-b6b3cb96cb85 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:31.354005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:31.355072 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:31.355353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:31.355628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.356380 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:31.358324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:31.391998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1253/2512] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:31 2022] POST /identity/v3/projects => generated 375 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:31.396081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ab81e-f7fa-495d-a036-f26e1a52e973 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:31.408093 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ab81e-f7fa-495d-a036-f26e1a52e973 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:31.472104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:31.473179 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:31.473509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:31.473817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.474571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:31.477297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:31.487340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:31.509980 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1260/2513] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:31 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:31.513856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:31.526858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a934b-4c45-4d69-aa29-11ce397258b8 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:31.532353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:31.533465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:31.537742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:31.538240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.539187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:31.541086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:31.544251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:31.560082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1254/2514] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:31.562812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:31.577221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1ea62-55e6-49aa-b015-23d3dfd817b8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:31.584469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:31.585810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:31.586127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:31.586536 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] PATH_INFO: `/v3/projects/390ad14005694bc188ea3cb14354bfc1/users/a4cad0790bde4565bcb1185f5c8693e0/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.637427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=390ad14005694bc188ea3cb14354bfc1, user_id=a4cad0790bde4565bcb1185f5c8693e0, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:31.648738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:31.671845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1261/2515] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:31 2022] PUT /identity/v3/projects/390ad14005694bc188ea3cb14354bfc1/users/a4cad0790bde4565bcb1185f5c8693e0/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:31.681490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:31.700715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02461c6-4909-434c-af94-8983cb30919d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:31.809238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61897753-e936-48da-92da-344e1b684f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:31.809952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61897753-e936-48da-92da-344e1b684f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:31.810266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61897753-e936-48da-92da-344e1b684f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:31.810570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61897753-e936-48da-92da-344e1b684f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.811507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61897753-e936-48da-92da-344e1b684f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:31.812922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61897753-e936-48da-92da-344e1b684f1b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:31.825287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1255/2516] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:31.829302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:31.840418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaacb97-ffb1-4186-806a-21f06dd20b1a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:31.845912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:31.846779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:31.847061 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:31.847442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] PATH_INFO: `/v3/projects/390ad14005694bc188ea3cb14354bfc1/users/a4cad0790bde4565bcb1185f5c8693e0/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.849381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=390ad14005694bc188ea3cb14354bfc1, user_id=a4cad0790bde4565bcb1185f5c8693e0, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:31.852730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:31.867469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1262/2517] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:31 2022] PUT /identity/v3/projects/390ad14005694bc188ea3cb14354bfc1/users/a4cad0790bde4565bcb1185f5c8693e0/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:31.879514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:31.880237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:31.880838 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:31.909781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] MFA Rules not processed for user `a4cad0790bde4565bcb1185f5c8693e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:31.911066 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:31.985772 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1256/2518] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:31.997702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:31.999497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:32.069814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5af84-3bbe-4496-8559-2a5a436103cb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:32.074946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:32.075625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:32.076070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:32.076970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:32.149631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:32.151735 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:32.165313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1263/2519] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:32.676296 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:32.677747 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:32.746450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a20e9e-4341-49f8-9748-c264f46545a2 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:32.753315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:32.754218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:32.754556 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:32.754791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] PATH_INFO: `/v3/users/8dd3035ec54f49f4ba0aec447532f7ea` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:32.756101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd3035ec54f49f4ba0aec447532f7ea)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:32.758074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:32.782974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:32.811056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd3035ec54f49f4ba0aec447532f7ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:32.811713 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd3035ec54f49f4ba0aec447532f7ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:32.812353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd3035ec54f49f4ba0aec447532f7ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:32.819810 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd3035ec54f49f4ba0aec447532f7ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:32.832654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd3035ec54f49f4ba0aec447532f7ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:32.846294 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1257/2520] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:32 2022] DELETE /identity/v3/users/8dd3035ec54f49f4ba0aec447532f7ea => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:33.103828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:33.120574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed7dc2-a118-476c-82d4-d545f1b7384d service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:33.183554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:33.184421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:33.184781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:33.185066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] PATH_INFO: `/v3/projects/ac64b737a78544f2a90d610708082eee` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:33.186801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac64b737a78544f2a90d610708082eee)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:33.188834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:33.200288 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:33.238169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac64b737a78544f2a90d610708082eee', 'request_id': 'req-13af8239-22d4-466f-ba8c-e7cceab4e9af'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.245717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac64b737a78544f2a90d610708082eee', 'request_id': 'req-13af8239-22d4-466f-ba8c-e7cceab4e9af'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.251573 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac64b737a78544f2a90d610708082eee', 'request_id': 'req-13af8239-22d4-466f-ba8c-e7cceab4e9af'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.263047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] The token cache is being invalidate because project ac64b737a78544f2a90d610708082eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:33.263358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.264026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.265608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1264/2521] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:33 2022] DELETE /identity/v3/projects/ac64b737a78544f2a90d610708082eee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:33.270004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:33.272129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:33.287037 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca5953-d8b7-4e7d-bd21-25c2f5256193 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:33.365046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:33.365953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:33.366257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:33.366570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] PATH_INFO: `/v3/users/76300bea457345ffb9a0bf8bad80ae0c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:33.367779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=76300bea457345ffb9a0bf8bad80ae0c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:33.369674 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:33.421254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76300bea457345ffb9a0bf8bad80ae0c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.421642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76300bea457345ffb9a0bf8bad80ae0c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.422353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76300bea457345ffb9a0bf8bad80ae0c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.429972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76300bea457345ffb9a0bf8bad80ae0c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.442062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76300bea457345ffb9a0bf8bad80ae0c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.458328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1258/2522] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:33 2022] DELETE /identity/v3/users/76300bea457345ffb9a0bf8bad80ae0c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:33.657392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:33.659737 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:33.673654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af8239-22d4-466f-ba8c-e7cceab4e9af admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:33.747418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:33.748297 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:33.748581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:33.748939 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] PATH_INFO: `/v3/projects/e35f2a3b63e04d83a92f742cd94e5553` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:33.750188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35f2a3b63e04d83a92f742cd94e5553)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:33.752877 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:33.811025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35f2a3b63e04d83a92f742cd94e5553', 'request_id': 'req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.813914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:33.815582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:33.821000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35f2a3b63e04d83a92f742cd94e5553', 'request_id': 'req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.828716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35f2a3b63e04d83a92f742cd94e5553', 'request_id': 'req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.841139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:33.850053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] The token cache is being invalidate because project e35f2a3b63e04d83a92f742cd94e5553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:33.850542 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.851423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:33.853817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1265/2523] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:33 2022] DELETE /identity/v3/projects/e35f2a3b63e04d83a92f742cd94e5553 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:33.902178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86886-fca2-4593-b334-1481db1417cc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:33.988542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c214-dfc8-4763-9d2a-47ac79738171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:33.989369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c214-dfc8-4763-9d2a-47ac79738171 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:33.989744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c214-dfc8-4763-9d2a-47ac79738171 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:33.990088 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c214-dfc8-4763-9d2a-47ac79738171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:33.992258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-daa8c214-dfc8-4763-9d2a-47ac79738171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:34.073149 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c214-dfc8-4763-9d2a-47ac79738171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:34.074675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c214-dfc8-4763-9d2a-47ac79738171 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:34.086397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1259/2524] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:34.732925 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:34.734838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:34.748177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d5b9e-7058-4c8c-8e93-75bc86ef85ea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:34.753253 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:34.753902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:34.754189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:34.754499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:34.756910 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:34.787309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:34.834835 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:34.836283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:34.846099 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1266/2525] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:36.656365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:36.658588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:36.658856 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:36.678996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:36.679952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:36.747243 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1260/2526] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:32:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:36.759856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:36.761329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:36.832355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e59400-9b5c-45b0-95b6-de8610cb67f8 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:36.838317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d304e-d284-4ac1-adc7-cbd044759449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:36.838831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d304e-d284-4ac1-adc7-cbd044759449 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:36.839074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d304e-d284-4ac1-adc7-cbd044759449 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:36.839378 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d304e-d284-4ac1-adc7-cbd044759449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:36.848396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d304e-d284-4ac1-adc7-cbd044759449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:36.850358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d304e-d284-4ac1-adc7-cbd044759449 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:36.859231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1267/2527] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:32:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 17:32:38.867761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:38.871238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:38.916031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:38.956372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65414add-e091-4877-92d7-930bf74b04b3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:38.961066 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:38.962000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:38.962505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:38.962783 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] PATH_INFO: `/v3/users/17fb9baa437c4922bc6385684288b2ca` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:38.964131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fb9baa437c4922bc6385684288b2ca)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:38.966114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:39.033013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fb9baa437c4922bc6385684288b2ca'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.034043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fb9baa437c4922bc6385684288b2ca'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.034784 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fb9baa437c4922bc6385684288b2ca'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.044346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fb9baa437c4922bc6385684288b2ca'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.065565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fb9baa437c4922bc6385684288b2ca'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.084438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1261/2528] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:38 2022] DELETE /identity/v3/users/17fb9baa437c4922bc6385684288b2ca => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:39.088846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:39.089377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:39.089608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:39.133344 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:39.135485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:39.218435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1268/2529] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:39.227644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:39.229730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:39.306086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6e2b7-f036-41f3-90d1-d5d55a4f72c6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:39.310261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:39.310961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:39.311428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:39.311704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:39.322265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:39.323755 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:39.334851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1262/2530] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:39.654540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:39.656402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:39.669934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed944-5a93-4722-8b5c-14a0d34f2d53 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:39.680157 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:39.681152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:39.681532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:39.681810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] PATH_INFO: `/v3/projects/d3007ab5536a41f286e4bccdc0608341` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:39.691351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3007ab5536a41f286e4bccdc0608341)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:39.693831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:39.764510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:39.766770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3007ab5536a41f286e4bccdc0608341', 'request_id': 'req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.779782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3007ab5536a41f286e4bccdc0608341', 'request_id': 'req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.787820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3007ab5536a41f286e4bccdc0608341', 'request_id': 'req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.804806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] The token cache is being invalidate because project d3007ab5536a41f286e4bccdc0608341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:39.805611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.806459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:39.808404 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1269/2531] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:39 2022] DELETE /identity/v3/projects/d3007ab5536a41f286e4bccdc0608341 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:39.812664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:39.824632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1d9d6-e2ba-46d0-804b-ffbac9c006fb service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:39.924939 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:39.937922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:39.938855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:39.939130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:39.939394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] PATH_INFO: `/v3/users/85cfb9b84f6e4288b46f9ff3c344b307` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:39.940715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cfb9b84f6e4288b46f9ff3c344b307)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:39.944756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:40.013585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cfb9b84f6e4288b46f9ff3c344b307'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.014709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cfb9b84f6e4288b46f9ff3c344b307'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.015602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cfb9b84f6e4288b46f9ff3c344b307'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.025990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cfb9b84f6e4288b46f9ff3c344b307'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.041750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cfb9b84f6e4288b46f9ff3c344b307'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.065561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1263/2532] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:39 2022] DELETE /identity/v3/users/85cfb9b84f6e4288b46f9ff3c344b307 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:40.749861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:40.752051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:40.771135 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7a3c0-1c0e-45f5-b480-11ee4d09dae2 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:40.842273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:40.843205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:40.843482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:40.843760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] PATH_INFO: `/v3/projects/775f8671a4124e45935061fe98a3b120` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:40.844969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=775f8671a4124e45935061fe98a3b120)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:40.847589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:40.920424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775f8671a4124e45935061fe98a3b120', 'request_id': 'req-0d7cc00b-11b0-492b-9022-639016c563fb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.931485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775f8671a4124e45935061fe98a3b120', 'request_id': 'req-0d7cc00b-11b0-492b-9022-639016c563fb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.943995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775f8671a4124e45935061fe98a3b120', 'request_id': 'req-0d7cc00b-11b0-492b-9022-639016c563fb'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.959896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] The token cache is being invalidate because project 775f8671a4124e45935061fe98a3b120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:40.960312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.961126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:40.966321 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1270/2533] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:40 2022] DELETE /identity/v3/projects/775f8671a4124e45935061fe98a3b120 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:40.967144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:40.968631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:40.983184 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4e41d-4224-4a0e-a87f-aa5dd362a73e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:41.066837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:41.068129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:41.068625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:41.069109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] PATH_INFO: `/v3/users/a4cad0790bde4565bcb1185f5c8693e0` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:41.070640 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cad0790bde4565bcb1185f5c8693e0)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:41.072806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:41.156620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cad0790bde4565bcb1185f5c8693e0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:41.157658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cad0790bde4565bcb1185f5c8693e0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:41.158561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cad0790bde4565bcb1185f5c8693e0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:41.168272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cad0790bde4565bcb1185f5c8693e0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:41.181715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2576cc28-e0a8-4c8d-9887-a5a41a239466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cad0790bde4565bcb1185f5c8693e0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:41.184615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:41.207702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1264/2534] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:40 2022] DELETE /identity/v3/users/a4cad0790bde4565bcb1185f5c8693e0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:32:41.828665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:41.830271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:41.858455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7cc00b-11b0-492b-9022-639016c563fb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:41.968535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:41.969689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:41.969977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:41.971112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] PATH_INFO: `/v3/projects/390ad14005694bc188ea3cb14354bfc1` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:41.973778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=390ad14005694bc188ea3cb14354bfc1)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:41.978461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:42.006830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:42.069956 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390ad14005694bc188ea3cb14354bfc1', 'request_id': 'req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:42.081009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390ad14005694bc188ea3cb14354bfc1', 'request_id': 'req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:42.088682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390ad14005694bc188ea3cb14354bfc1', 'request_id': 'req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:42.105276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] The token cache is being invalidate because project 390ad14005694bc188ea3cb14354bfc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:42.105694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:42.106318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-4da9473c-a001-4abc-a5e3-3d7db3aa5abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:42.108312 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1271/2535] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:41 2022] DELETE /identity/v3/projects/390ad14005694bc188ea3cb14354bfc1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:42.113602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1053228-0135-49e2-85b0-94303348f02e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.114458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1053228-0135-49e2-85b0-94303348f02e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.115008 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1053228-0135-49e2-85b0-94303348f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.135487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a1053228-0135-49e2-85b0-94303348f02e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:42.136979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1053228-0135-49e2-85b0-94303348f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:42.218334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1265/2536] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:42.223665 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4d69-ad57-49a6-9d06-8be9f64b3285 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.224169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4d69-ad57-49a6-9d06-8be9f64b3285 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.224594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc4d69-ad57-49a6-9d06-8be9f64b3285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.250180 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9bcc4d69-ad57-49a6-9d06-8be9f64b3285 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:42.251765 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bcc4d69-ad57-49a6-9d06-8be9f64b3285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:42.261428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1272/2537] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:42.265777 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1053228-0135-49e2-85b0-94303348f02e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:42.277626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1053228-0135-49e2-85b0-94303348f02e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:42.289111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:42.290657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.291141 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.291483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.292293 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:42.292668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:42.294405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:42.311265 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1266/2538] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:32:42.316235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4d69-ad57-49a6-9d06-8be9f64b3285 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:42.327601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc4d69-ad57-49a6-9d06-8be9f64b3285 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:42.339739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:42.340543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.342734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.343776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.344629 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:42.348262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:42.392190 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1273/2539] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:42 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:42.397188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:42.409731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16595-43ba-4448-8988-7d89b800c640 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:42.480612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:42.481303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.481589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.481876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.482599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:42.484542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:42.515788 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1267/2540] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:42 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:42.517341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:42.529015 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212c9f7-30d1-45d7-b009-0ef579b00cea admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:42.535659 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:42.536360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.536640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.537064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.537918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:42.539591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:42.553734 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1274/2541] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:42.556576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:42.568942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0da31-9fe3-4cdf-b797-86f1aeb17672 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:42.577920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9861463-2681-4fb2-822f-86a7db265cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:42.579237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861463-2681-4fb2-822f-86a7db265cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.579866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861463-2681-4fb2-822f-86a7db265cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.580466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9861463-2681-4fb2-822f-86a7db265cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.581940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861463-2681-4fb2-822f-86a7db265cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:42.583995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9861463-2681-4fb2-822f-86a7db265cdc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:42.600736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1268/2542] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:42.607614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:42.620558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70e9e-14bb-44af-a6ca-8911c0155be4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:42.633413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:42.634640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.634928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.635701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] PATH_INFO: `/v3/projects/91aec388436049408f13cf2d912655c0/users/4e8d7247460345229cc12a2fe1d33510/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.654822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91aec388436049408f13cf2d912655c0, user_id=4e8d7247460345229cc12a2fe1d33510, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:42.657584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:42.682537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1275/2543] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:42 2022] PUT /identity/v3/projects/91aec388436049408f13cf2d912655c0/users/4e8d7247460345229cc12a2fe1d33510/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:32:42.689236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40fa18-b6f2-49cc-8127-efd6d6df89c0 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.690065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40fa18-b6f2-49cc-8127-efd6d6df89c0 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.690887 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40fa18-b6f2-49cc-8127-efd6d6df89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:42.734500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4c40fa18-b6f2-49cc-8127-efd6d6df89c0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:42.736074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4c40fa18-b6f2-49cc-8127-efd6d6df89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:42.873658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:42.892527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1269/2544] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:42.902817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:42.904769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:42.987084 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebda919-e3d6-41c0-9775-b7f533a419c4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:42.991967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:42.992769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:42.993192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:42.993471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:43.004343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:43.005955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:43.034338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1276/2545] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:44.517341 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27ae4-0da0-4756-98bd-df5347ec2701 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:44.518022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27ae4-0da0-4756-98bd-df5347ec2701 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:44.518022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27ae4-0da0-4756-98bd-df5347ec2701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:44.553487 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e6e27ae4-0da0-4756-98bd-df5347ec2701 None None] MFA Rules not processed for user `4e8d7247460345229cc12a2fe1d33510`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:44.555099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e6e27ae4-0da0-4756-98bd-df5347ec2701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:44.690444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1270/2546] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:44.704796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:44.706586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:44.768310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:44.790839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722bcb6-8003-4f4a-b667-ff2402a5c607 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:44.795272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:44.795938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:44.796219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:44.796491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:44.805776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:44.807539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:44.830598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1277/2547] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:32:46.316765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:46.317323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:46.317323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:46.346232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] MFA Rules not processed for user `4e8d7247460345229cc12a2fe1d33510`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:46.347598 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:46.356632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1271/2548] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:46.696384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:46.697998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:46.711668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80b6c5-2d41-4278-b206-ba09b790b017 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:46.715994 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:46.716688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:46.716973 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:46.717303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:46.719318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:46.731627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:46.733409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:46.745222 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1278/2549] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:47.087048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:47.088779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:47.171302 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb43ce4-b807-4d34-8488-4695cdc0ce0a None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:47.178068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:47.178754 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:47.179058 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:47.179313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:47.181157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:47.193445 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:47.195178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:47.205333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1272/2550] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:47.705653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:47.708898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:47.717264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fed8d6-6d6f-4e51-8e24-cc9a1c3d379e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:47.719634 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3987c-0100-406b-a041-7603ffa6a9ef service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:47.722424 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:47.723205 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:47.723510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:47.723784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:47.724625 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:47.725277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:47.725534 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:47.725803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:47.726057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:47.727561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:47.737520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:47.739748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:47.740356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:47.741868 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:47.750452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1279/2551] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:47.754919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1273/2552] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:51.809698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:51.811367 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:51.831894 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825fac94-1262-4ff1-b7e1-f36121e0997e service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:51.839370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:51.840358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:51.840838 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:51.841175 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] PATH_INFO: `/v3/users/190092274f6843959bf16a569a388ccf` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:51.842804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190092274f6843959bf16a569a388ccf)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:51.844831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:51.902943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190092274f6843959bf16a569a388ccf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:51.916718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190092274f6843959bf16a569a388ccf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:51.933033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190092274f6843959bf16a569a388ccf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:51.942718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190092274f6843959bf16a569a388ccf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:51.944075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-974bf31f-731b-4200-84de-2c5b41a7f878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190092274f6843959bf16a569a388ccf'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:51.955386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1280/2553] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:51 2022] DELETE /identity/v3/users/190092274f6843959bf16a569a388ccf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:52.201948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.213292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac641a3-5a45-48d6-a12b-0d83f8217f24 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.294173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.294918 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.295197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.295468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] PATH_INFO: `/v3/projects/44be58fc071b4bc0a71209b14af25335` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.296697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44be58fc071b4bc0a71209b14af25335)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:52.298931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:52.300786 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:52.357131 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44be58fc071b4bc0a71209b14af25335', 'request_id': 'req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:52.363110 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44be58fc071b4bc0a71209b14af25335', 'request_id': 'req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:52.372395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44be58fc071b4bc0a71209b14af25335', 'request_id': 'req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:52.386753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] The token cache is being invalidate because project 44be58fc071b4bc0a71209b14af25335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:52.387051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:52.387705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3cf0db1d-3dbb-41ed-9072-6a7c770a7b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:52.393409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1274/2554] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:52 2022] DELETE /identity/v3/projects/44be58fc071b4bc0a71209b14af25335 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:52.396210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c1b11-fc45-4dc4-8af1-e809df4d7d71 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.396503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c1b11-fc45-4dc4-8af1-e809df4d7d71 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.396787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c1b11-fc45-4dc4-8af1-e809df4d7d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.419760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-cf1c1b11-fc45-4dc4-8af1-e809df4d7d71 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:52.421111 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cf1c1b11-fc45-4dc4-8af1-e809df4d7d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:52.493234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1281/2555] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:52.502224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f59073-92a4-458a-acea-a938157275dd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.502703 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f59073-92a4-458a-acea-a938157275dd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.503248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f59073-92a4-458a-acea-a938157275dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.522720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-99f59073-92a4-458a-acea-a938157275dd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:52.524105 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-99f59073-92a4-458a-acea-a938157275dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:52.539024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1275/2556] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:52.543448 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c1b11-fc45-4dc4-8af1-e809df4d7d71 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.553455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c1b11-fc45-4dc4-8af1-e809df4d7d71 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.558100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.558793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.559077 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.559354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.560740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:52.560740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:52.562021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:52.580504 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1282/2557] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:32:52.586597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f59073-92a4-458a-acea-a938157275dd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.602864 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f59073-92a4-458a-acea-a938157275dd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.608654 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.609425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.609815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.609976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.610871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:52.613078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:52.645106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1276/2558] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:52 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:52.649343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.661631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f3518-943f-4351-a44c-9669ff79faaf admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.671590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:52.686063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.689166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:52.800283 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b903-2dcc-4477-ba14-bbbd088e4df2 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.802195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bac1f1-cda2-4de0-9e0b-55d4dfdbbc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.803999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac1f1-cda2-4de0-9e0b-55d4dfdbbc86 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.803999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac1f1-cda2-4de0-9e0b-55d4dfdbbc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.803999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bac1f1-cda2-4de0-9e0b-55d4dfdbbc86 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.804920 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bac1f1-cda2-4de0-9e0b-55d4dfdbbc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:52.806724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d940d-2803-4b82-a35b-43ac7b6afad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.807020 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bac1f1-cda2-4de0-9e0b-55d4dfdbbc86 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:52.807521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d940d-2803-4b82-a35b-43ac7b6afad9 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.807871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d940d-2803-4b82-a35b-43ac7b6afad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.808224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d940d-2803-4b82-a35b-43ac7b6afad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.810115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-053d940d-2803-4b82-a35b-43ac7b6afad9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:52.824446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d940d-2803-4b82-a35b-43ac7b6afad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:52.830701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d940d-2803-4b82-a35b-43ac7b6afad9 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:52.832269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1283/2559] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:52 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:52.834128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c68ab-1166-490d-a157-e310f9f85d6c None None] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.834445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c68ab-1166-490d-a157-e310f9f85d6c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.834718 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c68ab-1166-490d-a157-e310f9f85d6c None None] PATH_INFO: `/` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.836184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1284/2560] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:32:52.837044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c68ab-1166-490d-a157-e310f9f85d6c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.851677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c68ab-1166-490d-a157-e310f9f85d6c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.856424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1277/2561] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:52.858045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.858195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.858489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.858837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.859379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.859804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.860218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.861106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:52.863452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:52.876189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1285/2562] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:52.882537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.893886 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:52.896542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:52.902918 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452d360-cc90-48df-854f-c33b9644b468 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.918760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1278/2563] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:32:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:52.919060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.920197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.920623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.921334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.922081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:52.923770 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:52.931430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.932889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:52.938818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1286/2564] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:32:52.950841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:52.972696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9227676-aafc-4a8c-9aff-e2cd97f91d8c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:52.980551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0980435-7534-4281-bf9b-a910a75dc4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:52.981812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:52.981947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980435-7534-4281-bf9b-a910a75dc4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:52.982647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980435-7534-4281-bf9b-a910a75dc4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:52.983267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0980435-7534-4281-bf9b-a910a75dc4e4 admin admin] PATH_INFO: `/v3/projects/59e5c315fab14c2a985b0916e2c9aeeb/users/897fa428b83944f09d0ddb4661e35b60/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:52.999040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee7884-d2c4-4e8d-9d53-109e523c32d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:53.003213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0aad2-2152-4f31-bb69-7fa60b4829fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:53.004016 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0aad2-2152-4f31-bb69-7fa60b4829fb service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.004298 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0aad2-2152-4f31-bb69-7fa60b4829fb service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.004576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0aad2-2152-4f31-bb69-7fa60b4829fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.004780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980435-7534-4281-bf9b-a910a75dc4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e5c315fab14c2a985b0916e2c9aeeb, user_id=897fa428b83944f09d0ddb4661e35b60, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:53.008333 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0980435-7534-4281-bf9b-a910a75dc4e4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:53.018716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0aad2-2152-4f31-bb69-7fa60b4829fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:53.020219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0aad2-2152-4f31-bb69-7fa60b4829fb service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:53.027707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1287/2565] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:52 2022] PUT /identity/v3/projects/59e5c315fab14c2a985b0916e2c9aeeb/users/897fa428b83944f09d0ddb4661e35b60/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:53.038419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.039123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.039552 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.040041 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1279/2566] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:32:53.073301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] MFA Rules not processed for user `897fa428b83944f09d0ddb4661e35b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:53.074688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:53.117681 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34d81-7250-4785-a392-8b6412fdf22d None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.118229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34d81-7250-4785-a392-8b6412fdf22d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.118517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34d81-7250-4785-a392-8b6412fdf22d None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.120109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1280/2567] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:32:53.125261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139369e-444c-4676-b7a9-154c205d212b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.125572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139369e-444c-4676-b7a9-154c205d212b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.125841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139369e-444c-4676-b7a9-154c205d212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.146424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d139369e-444c-4676-b7a9-154c205d212b None None] MFA Rules not processed for user `164446c4b65e4043a492dc626a571e81`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:53.147506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d139369e-444c-4676-b7a9-154c205d212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:53.156231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1288/2568] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:53.167466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:53.168954 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:53.222402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:53.224345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1281/2569] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:32:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:53.238716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139369e-444c-4676-b7a9-154c205d212b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:53.240702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d139369e-444c-4676-b7a9-154c205d212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:53.252070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139369e-444c-4676-b7a9-154c205d212b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:53.254337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee6b5a-149c-4ed2-b9ef-4a2ea940b34d None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:53.256029 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa496f-108b-4ab2-9541-d7578eebdf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:53.256684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa496f-108b-4ab2-9541-d7578eebdf70 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.256964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa496f-108b-4ab2-9541-d7578eebdf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.257234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa496f-108b-4ab2-9541-d7578eebdf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.260680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f408c67-7c12-4c96-9f78-35bb94401001 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:53.261264 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f408c67-7c12-4c96-9f78-35bb94401001 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.261559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f408c67-7c12-4c96-9f78-35bb94401001 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.261816 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f408c67-7c12-4c96-9f78-35bb94401001 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.265389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa496f-108b-4ab2-9541-d7578eebdf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:53.266972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa496f-108b-4ab2-9541-d7578eebdf70 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:53.270624 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f408c67-7c12-4c96-9f78-35bb94401001 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:53.272215 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f408c67-7c12-4c96-9f78-35bb94401001 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:53.275469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1282/2570] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:53.281454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1289/2571] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:32:53.366548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8f5d-51ae-49c5-a4ce-26b9ca1f5070 None None] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.366827 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8f5d-51ae-49c5-a4ce-26b9ca1f5070 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.367097 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f8f5d-51ae-49c5-a4ce-26b9ca1f5070 None None] PATH_INFO: `/` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.368457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1283/2572] 10.222.0.50 () {54 vars in 921 bytes} [Tue Jul 12 17:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 17:32:53.374506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535443-fc8d-4ba1-bfbc-a525d4f486c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.374806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535443-fc8d-4ba1-bfbc-a525d4f486c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.375086 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6535443-fc8d-4ba1-bfbc-a525d4f486c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.394400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a6535443-fc8d-4ba1-bfbc-a525d4f486c0 None None] MFA Rules not processed for user `5253b3eec6ae45f3bca9369107c4d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:53.395614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a6535443-fc8d-4ba1-bfbc-a525d4f486c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:53.411475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1290/2573] 10.222.0.50 () {58 vars in 1018 bytes} [Tue Jul 12 17:32:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:53.426271 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f8f5d-51ae-49c5-a4ce-26b9ca1f5070 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:53.437848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f8f5d-51ae-49c5-a4ce-26b9ca1f5070 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:53.442388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4408-a59a-411a-ba6b-6a619af82d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:53.442950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4408-a59a-411a-ba6b-6a619af82d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.443300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4408-a59a-411a-ba6b-6a619af82d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.443642 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4408-a59a-411a-ba6b-6a619af82d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.455914 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da4408-a59a-411a-ba6b-6a619af82d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:53.457665 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da4408-a59a-411a-ba6b-6a619af82d8d service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:53.476399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1284/2574] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:53.519579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535443-fc8d-4ba1-bfbc-a525d4f486c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:53.585386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6535443-fc8d-4ba1-bfbc-a525d4f486c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:53.590133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:53.591062 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.591470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.591869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] PATH_INFO: `/v3/users/897fa428b83944f09d0ddb4661e35b60` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.598092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897fa428b83944f09d0ddb4661e35b60)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:53.598092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:53.648002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897fa428b83944f09d0ddb4661e35b60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:53.655739 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897fa428b83944f09d0ddb4661e35b60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:53.668722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897fa428b83944f09d0ddb4661e35b60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:53.679508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897fa428b83944f09d0ddb4661e35b60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:53.680285 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897fa428b83944f09d0ddb4661e35b60'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:53.686371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1291/2575] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:53 2022] DELETE /identity/v3/users/897fa428b83944f09d0ddb4661e35b60 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:53.691180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.691539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.691851 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.709823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:53.711089 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:53.772549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1285/2576] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:32:53.782542 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:53.783987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:53.830605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:53.843953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624a501-344d-4ce2-8be0-ee807aedc8f8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:53.849678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283a5ad-c5ce-4b82-936a-137e9974121d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:53.850383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a5ad-c5ce-4b82-936a-137e9974121d service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:53.850668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a5ad-c5ce-4b82-936a-137e9974121d service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:53.850944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283a5ad-c5ce-4b82-936a-137e9974121d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:53.861386 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283a5ad-c5ce-4b82-936a-137e9974121d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:53.862989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283a5ad-c5ce-4b82-936a-137e9974121d service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:53.873156 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1292/2577] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:54.266308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:54.268405 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:54.291628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca1c73-a431-4896-8f36-45e34d73d25f None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:54.296807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:54.297705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.298565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.298874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] PATH_INFO: `/v3/projects/59e5c315fab14c2a985b0916e2c9aeeb` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.300303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e5c315fab14c2a985b0916e2c9aeeb)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:54.302334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:54.373125 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e5c315fab14c2a985b0916e2c9aeeb', 'request_id': 'req-35b21f76-741c-488e-8153-e05ac767e1fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:54.384057 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e5c315fab14c2a985b0916e2c9aeeb', 'request_id': 'req-35b21f76-741c-488e-8153-e05ac767e1fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:54.387412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:54.393971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e5c315fab14c2a985b0916e2c9aeeb', 'request_id': 'req-35b21f76-741c-488e-8153-e05ac767e1fc'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:54.411043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] The token cache is being invalidate because project 59e5c315fab14c2a985b0916e2c9aeeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:54.411796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:54.412225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-35b21f76-741c-488e-8153-e05ac767e1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:54.414304 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1286/2578] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:54 2022] DELETE /identity/v3/projects/59e5c315fab14c2a985b0916e2c9aeeb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:54.419295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2337d-336a-4938-a6e9-eac626bfd42e None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.419828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2337d-336a-4938-a6e9-eac626bfd42e None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.420174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2337d-336a-4938-a6e9-eac626bfd42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.441919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-50b2337d-336a-4938-a6e9-eac626bfd42e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:54.442528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-50b2337d-336a-4938-a6e9-eac626bfd42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:54.519177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1293/2579] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:54.527765 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c410-18af-4838-888d-69ef8c10d1f1 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.528194 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c410-18af-4838-888d-69ef8c10d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.528570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5c410-18af-4838-888d-69ef8c10d1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.554739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-a3b5c410-18af-4838-888d-69ef8c10d1f1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:54.555862 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a3b5c410-18af-4838-888d-69ef8c10d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:54.564391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1287/2580] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:54.569731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2337d-336a-4938-a6e9-eac626bfd42e None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:54.586675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2337d-336a-4938-a6e9-eac626bfd42e None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:54.594145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:54.595230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.595523 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.595991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.596634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:54.596913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:54.598650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:54.612747 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1294/2581] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:32:54.618388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c410-18af-4838-888d-69ef8c10d1f1 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:54.631234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5c410-18af-4838-888d-69ef8c10d1f1 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:54.638200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:54.639227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.639632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.639979 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.640808 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:54.642974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:54.677532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1288/2582] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:54 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:54.681952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:54.692168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a49e3-961f-4249-aead-f8d9cb0ddfe9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:54.754453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:54.755233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.755460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.755759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.756459 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:54.758417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:54.779794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1295/2583] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:54 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:54.784054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:54.795347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8d0e0-07b3-4c85-a14a-f720c6925fd3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:54.809083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:54.809778 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.810054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.810356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.811086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:54.812715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:54.825947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1289/2584] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:54.829670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:54.841053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb712b-a42c-496b-8935-be6a24c35487 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:54.847055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1da4a6-8e8b-4ca9-b3bb-1df54c1ad932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:54.847738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1da4a6-8e8b-4ca9-b3bb-1df54c1ad932 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.848023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1da4a6-8e8b-4ca9-b3bb-1df54c1ad932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.848299 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1da4a6-8e8b-4ca9-b3bb-1df54c1ad932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.849033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1da4a6-8e8b-4ca9-b3bb-1df54c1ad932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:54.850690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1da4a6-8e8b-4ca9-b3bb-1df54c1ad932 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:54.862055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1296/2585] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:54.867773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:54.880505 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa744dff-40cc-471b-b111-153673ae9444 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:54.885949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:54.886901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.887183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.887460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] PATH_INFO: `/v3/projects/009480e9e956463b85edef037a5970d4/users/a39997d7d5c84ed7b7bde4cf4219ae76/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.904526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=009480e9e956463b85edef037a5970d4, user_id=a39997d7d5c84ed7b7bde4cf4219ae76, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:54.908106 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:54.928628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1290/2586] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:54 2022] PUT /identity/v3/projects/009480e9e956463b85edef037a5970d4/users/a39997d7d5c84ed7b7bde4cf4219ae76/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:54.941730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8c9f-cf55-4c72-80de-f98b4630f7e7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:54.942044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8c9f-cf55-4c72-80de-f98b4630f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:54.942349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b8c9f-cf55-4c72-80de-f98b4630f7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:54.971807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fa6b8c9f-cf55-4c72-80de-f98b4630f7e7 None None] MFA Rules not processed for user `a39997d7d5c84ed7b7bde4cf4219ae76`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:54.973334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa6b8c9f-cf55-4c72-80de-f98b4630f7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:55.020158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:55.045766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1297/2587] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:55.050675 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.113723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02272076-ee1c-415a-87df-8593fb290608 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.119239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.119913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.120195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.120471 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.121158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.123145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.156577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1291/2588] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:55 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:55.157806 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b8c9f-cf55-4c72-80de-f98b4630f7e7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.169549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b8c9f-cf55-4c72-80de-f98b4630f7e7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.233773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.234522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.234809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.235089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.235778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.237790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.259052 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1298/2589] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:55 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:55.263221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.274787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d695ff-e5e1-4e2f-b48d-ab60c4c585c3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.279828 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.280515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.280807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.281087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.281855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.283941 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.295100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1292/2590] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:32:55.300124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.310670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1b5b-ea88-4595-95c5-b403d0dfd1a9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.318655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.319570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.319853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.320129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] PATH_INFO: `/v3/projects/e0d02d16583949178783099be71c22ab/users/846ec07575f54eb68fa24b089b8cb6dc/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.338863 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d02d16583949178783099be71c22ab, user_id=846ec07575f54eb68fa24b089b8cb6dc, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.341549 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.356101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1299/2591] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:55 2022] PUT /identity/v3/projects/e0d02d16583949178783099be71c22ab/users/846ec07575f54eb68fa24b089b8cb6dc/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:55.360163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.370676 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee78a0-0d6e-49ef-9fe4-2b71a1107c92 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.435120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1bb8d-cec0-4e6c-985e-319aaa12a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.435798 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1bb8d-cec0-4e6c-985e-319aaa12a18f admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.436078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1bb8d-cec0-4e6c-985e-319aaa12a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.436356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1bb8d-cec0-4e6c-985e-319aaa12a18f admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.437079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1bb8d-cec0-4e6c-985e-319aaa12a18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.438731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1bb8d-cec0-4e6c-985e-319aaa12a18f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.440179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:55.450411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1293/2592] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:55.454493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.467611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b350e7-159c-4e96-a014-f602891a7af3 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.472588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.473495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.473779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.474054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] PATH_INFO: `/v3/projects/e0d02d16583949178783099be71c22ab/users/846ec07575f54eb68fa24b089b8cb6dc/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.476110 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d02d16583949178783099be71c22ab, user_id=846ec07575f54eb68fa24b089b8cb6dc, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.480787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.492494 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1300/2593] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:32:55 2022] PUT /identity/v3/projects/e0d02d16583949178783099be71c22ab/users/846ec07575f54eb68fa24b089b8cb6dc/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:55.503246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68e4f-2240-4e5a-a43d-4310040a67ed None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.503559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68e4f-2240-4e5a-a43d-4310040a67ed None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.503803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba68e4f-2240-4e5a-a43d-4310040a67ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.532975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4ba68e4f-2240-4e5a-a43d-4310040a67ed None None] MFA Rules not processed for user `846ec07575f54eb68fa24b089b8cb6dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:55.534278 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4ba68e4f-2240-4e5a-a43d-4310040a67ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:55.612895 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1294/2594] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:55.624211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.626072 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:55.691407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339248e1-9405-476f-b165-5bd29ccf2d71 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.695269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.695912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.696192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.696465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.705813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.707319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.717136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1301/2595] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:55.767133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682345-d630-4fbe-881d-6f1bd320dbc4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.767423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682345-d630-4fbe-881d-6f1bd320dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.767735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c682345-d630-4fbe-881d-6f1bd320dbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.791174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-7c682345-d630-4fbe-881d-6f1bd320dbc4 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:55.791174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7c682345-d630-4fbe-881d-6f1bd320dbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:55.849418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1295/2596] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:32:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:55.862764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:55.864295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:55.909947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:55.943769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa20418-d20b-409b-a06f-fbe318d87f76 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:55.950368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4258d0-6efd-45fb-834e-def4065e133d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:55.951124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4258d0-6efd-45fb-834e-def4065e133d service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:55.951470 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4258d0-6efd-45fb-834e-def4065e133d service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:55.951805 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4258d0-6efd-45fb-834e-def4065e133d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:55.962604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4258d0-6efd-45fb-834e-def4065e133d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:55.964499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4258d0-6efd-45fb-834e-def4065e133d service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:55.979598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1302/2597] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:32:57.551698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682345-d630-4fbe-881d-6f1bd320dbc4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:57.629443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c682345-d630-4fbe-881d-6f1bd320dbc4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:57.634249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:57.635185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:57.635466 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:57.635750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] PATH_INFO: `/v3/users/a39997d7d5c84ed7b7bde4cf4219ae76` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:57.636990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39997d7d5c84ed7b7bde4cf4219ae76)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:57.639020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:57.672575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:57.701797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39997d7d5c84ed7b7bde4cf4219ae76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:57.703019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39997d7d5c84ed7b7bde4cf4219ae76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:57.703628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39997d7d5c84ed7b7bde4cf4219ae76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:57.712701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39997d7d5c84ed7b7bde4cf4219ae76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:57.735127 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39997d7d5c84ed7b7bde4cf4219ae76'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:57.769022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1296/2598] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:57 2022] DELETE /identity/v3/users/a39997d7d5c84ed7b7bde4cf4219ae76 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:57.773803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:57.774813 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:57.775102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:57.795873 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:57.797113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:57.885890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1303/2599] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:57.897412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:57.898899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:57.994669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5a934-1720-44ef-80de-4043b9b70a6e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:57.998539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:57.999298 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:57.999719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:57.999996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:58.013748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:58.018493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:58.038399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1297/2600] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:58.156487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:58.158511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:58.360174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb247ea-e64b-4796-ba06-e849055e73da None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:58.367043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:58.368033 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:58.368410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:58.368793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:58.370940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:58.386875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:58.388915 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:58.416007 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1304/2601] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:32:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:32:58.510859 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:58.512511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:58.529988 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90f01f-96b5-4242-b1c2-e520da483957 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:58.536034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:58.536935 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:58.537221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:58.537502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] PATH_INFO: `/v3/projects/009480e9e956463b85edef037a5970d4` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:58.538749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=009480e9e956463b85edef037a5970d4)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:58.543950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:58.657929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '009480e9e956463b85edef037a5970d4', 'request_id': 'req-6b7625ce-4e2f-47c7-9203-986b7f43cffd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.671486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '009480e9e956463b85edef037a5970d4', 'request_id': 'req-6b7625ce-4e2f-47c7-9203-986b7f43cffd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.684369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '009480e9e956463b85edef037a5970d4', 'request_id': 'req-6b7625ce-4e2f-47c7-9203-986b7f43cffd'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.714550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] The token cache is being invalidate because project 009480e9e956463b85edef037a5970d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:58.715449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.716774 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.723997 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1298/2602] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:58 2022] DELETE /identity/v3/projects/009480e9e956463b85edef037a5970d4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:58.724802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:58.738408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe29a56-ef27-436c-8a60-6ad757b4f546 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:58.795648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:58.808996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:58.809906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:58.810195 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:58.810585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] PATH_INFO: `/v3/users/846ec07575f54eb68fa24b089b8cb6dc` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:58.812122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=846ec07575f54eb68fa24b089b8cb6dc)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:58.814966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:58.867858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846ec07575f54eb68fa24b089b8cb6dc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.876461 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846ec07575f54eb68fa24b089b8cb6dc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.899579 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846ec07575f54eb68fa24b089b8cb6dc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.907906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846ec07575f54eb68fa24b089b8cb6dc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.909456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-cacfd96c-c005-4ef6-b8e9-f12f672e81c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846ec07575f54eb68fa24b089b8cb6dc'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:58.915551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1305/2603] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:32:58 2022] DELETE /identity/v3/users/846ec07575f54eb68fa24b089b8cb6dc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:59.298890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:59.300799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:59.321606 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7625ce-4e2f-47c7-9203-986b7f43cffd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:59.383017 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:59.436457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:59.437376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.437658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.437932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] PATH_INFO: `/v3/projects/e0d02d16583949178783099be71c22ab` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.439284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d02d16583949178783099be71c22ab)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:59.448541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:59.506776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d02d16583949178783099be71c22ab', 'request_id': 'req-3803e470-a8c0-4fd8-be4f-175c227f3926'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:59.522709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d02d16583949178783099be71c22ab', 'request_id': 'req-3803e470-a8c0-4fd8-be4f-175c227f3926'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:59.530832 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d02d16583949178783099be71c22ab', 'request_id': 'req-3803e470-a8c0-4fd8-be4f-175c227f3926'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:59.557913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] The token cache is being invalidate because project e0d02d16583949178783099be71c22ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:32:59.558249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:59.559913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3803e470-a8c0-4fd8-be4f-175c227f3926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:32:59.563021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1299/2604] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:32:59 2022] DELETE /identity/v3/projects/e0d02d16583949178783099be71c22ab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:32:59.567828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ac67-633b-41ee-85af-d33ed30babcb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.568126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ac67-633b-41ee-85af-d33ed30babcb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.568410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ac67-633b-41ee-85af-d33ed30babcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.594115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-49e1ac67-633b-41ee-85af-d33ed30babcb None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:59.595513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-49e1ac67-633b-41ee-85af-d33ed30babcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:59.674396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1306/2605] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:59.676411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c5f2a-df7a-443c-8cee-bdd58b164a5b None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.676984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c5f2a-df7a-443c-8cee-bdd58b164a5b None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.677094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c5f2a-df7a-443c-8cee-bdd58b164a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.696512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-e82c5f2a-df7a-443c-8cee-bdd58b164a5b None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:32:59.697837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e82c5f2a-df7a-443c-8cee-bdd58b164a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:32:59.706516 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1300/2606] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:32:59.711234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ac67-633b-41ee-85af-d33ed30babcb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:59.722122 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ac67-633b-41ee-85af-d33ed30babcb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:59.726811 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:59.727487 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.727766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.728037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.729258 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:32:59.729564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:59.731239 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:59.744491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1307/2607] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:32:59.749062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c5f2a-df7a-443c-8cee-bdd58b164a5b None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:59.758906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c5f2a-df7a-443c-8cee-bdd58b164a5b None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:59.763513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:59.764172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.764456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.764730 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.765430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:59.767389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:59.806033 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1301/2608] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:32:59 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:32:59.807134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:59.817800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7564925-ae38-4040-86a3-7b4d3cfd1957 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:59.878707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:32:59.887191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:59.888185 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.888495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.888780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.889673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:59.892373 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:59.918953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1308/2609] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:32:59 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:32:59.920303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:59.931275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a45e3-b76d-4d26-969d-1f3d4cafbd7c admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:59.936102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:59.936764 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.937048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.937323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.938070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:59.939959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:32:59.953111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1302/2610] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:32:59.958618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:32:59.972790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172ab63-3ce2-4f15-af32-4e93fa1e2b15 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:32:59.978525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bcb54e-e4f0-474f-9abb-af192291b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:32:59.980035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcb54e-e4f0-474f-9abb-af192291b7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:32:59.980305 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcb54e-e4f0-474f-9abb-af192291b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:32:59.980577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bcb54e-e4f0-474f-9abb-af192291b7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:32:59.981469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcb54e-e4f0-474f-9abb-af192291b7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:32:59.983279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bcb54e-e4f0-474f-9abb-af192291b7bd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.004304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1309/2611] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:33:00.008268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.019646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6600094-c14d-4019-92be-8387d28148fd admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.024457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.025356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.025637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.025907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] PATH_INFO: `/v3/projects/2f50fcbb0b2a4d2c95b2d9bf9ce4283a/users/6046884c8cf547f2ae3f7907f0a0ef43/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.041892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f50fcbb0b2a4d2c95b2d9bf9ce4283a, user_id=6046884c8cf547f2ae3f7907f0a0ef43, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.045629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.073670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1303/2612] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:00 2022] PUT /identity/v3/projects/2f50fcbb0b2a4d2c95b2d9bf9ce4283a/users/6046884c8cf547f2ae3f7907f0a0ef43/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:00.076113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5dbcc-b894-4fde-a53c-cc8d16610092 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.076411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5dbcc-b894-4fde-a53c-cc8d16610092 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.076690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5dbcc-b894-4fde-a53c-cc8d16610092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.109129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-eef5dbcc-b894-4fde-a53c-cc8d16610092 None None] MFA Rules not processed for user `6046884c8cf547f2ae3f7907f0a0ef43`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:00.110512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eef5dbcc-b894-4fde-a53c-cc8d16610092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:00.194100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1310/2613] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:00.199551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.274204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:00.279121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f6dcf-83e4-4fa8-9837-b854eac24d0e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.287657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.288694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.289051 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.289427 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.290247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.292514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.327250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1304/2614] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:33:00 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:00.331561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5dbcc-b894-4fde-a53c-cc8d16610092 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.343532 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5dbcc-b894-4fde-a53c-cc8d16610092 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.411966 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.412652 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.412931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.413202 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.414054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.416182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.439742 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1311/2615] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:33:00 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:00.443902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.458657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f84c2b-85d5-49a4-9afa-4b594a96e08d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.464281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.464945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.465229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.465506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.466250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.468096 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.481431 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1305/2616] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:00.485917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.497940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b98b26-22a8-4e31-ac74-142b05928155 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.503787 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.504723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.505039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.505316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] PATH_INFO: `/v3/projects/6af9603c929c4dcbbdf668ee4a3d853a/users/8934741b415544058c3498b0ccd61532/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.540220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af9603c929c4dcbbdf668ee4a3d853a, user_id=8934741b415544058c3498b0ccd61532, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.547558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.562265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1312/2617] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:00 2022] PUT /identity/v3/projects/6af9603c929c4dcbbdf668ee4a3d853a/users/8934741b415544058c3498b0ccd61532/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:33:00.568295 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.586339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc1451-2008-4c19-b293-37a4b2cea7fc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.667807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b423b5-429d-44c9-9c42-9d6ada5ffa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.668486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b423b5-429d-44c9-9c42-9d6ada5ffa1d admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.668763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b423b5-429d-44c9-9c42-9d6ada5ffa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.669032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b423b5-429d-44c9-9c42-9d6ada5ffa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.669761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b423b5-429d-44c9-9c42-9d6ada5ffa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.671392 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b423b5-429d-44c9-9c42-9d6ada5ffa1d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.684938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1306/2618] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:00.689081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.700250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23f28-c366-48e4-8373-6433398a4f76 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.711229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.712325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.712618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.713022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] PATH_INFO: `/v3/projects/6af9603c929c4dcbbdf668ee4a3d853a/users/8934741b415544058c3498b0ccd61532/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.716778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af9603c929c4dcbbdf668ee4a3d853a, user_id=8934741b415544058c3498b0ccd61532, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.717773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.741197 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1313/2619] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:00 2022] PUT /identity/v3/projects/6af9603c929c4dcbbdf668ee4a3d853a/users/8934741b415544058c3498b0ccd61532/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:00.741373 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.741474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.741720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.781732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] MFA Rules not processed for user `8934741b415544058c3498b0ccd61532`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:00.783146 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:00.868054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1307/2620] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:00.875469 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:00.877773 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:00.902767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:00.942672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6124ad8-009f-4e4e-9632-83ef6795e5c6 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:00.946607 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:00.947560 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:00.947852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:00.948131 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:00.958622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:00.960221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:00.980784 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1314/2621] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:33:01.031883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:01.033909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:01.046212 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eda91-2d68-45c8-ae28-9b68f1129b28 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:01.050206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4931c09-754e-445a-b68e-039a1f9ef0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:01.050995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931c09-754e-445a-b68e-039a1f9ef0ac service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:01.051340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931c09-754e-445a-b68e-039a1f9ef0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:01.051673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931c09-754e-445a-b68e-039a1f9ef0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:01.103328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:01.114735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4931c09-754e-445a-b68e-039a1f9ef0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:01.116454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4931c09-754e-445a-b68e-039a1f9ef0ac service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:01.128252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1308/2622] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:04.617318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:04.689938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eef49f-8f61-486f-8908-192dd60be075 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:04.695751 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:04.696638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:04.696917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:04.697192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] PATH_INFO: `/v3/users/6046884c8cf547f2ae3f7907f0a0ef43` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:04.698479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6046884c8cf547f2ae3f7907f0a0ef43)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:04.700412 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:04.752680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6046884c8cf547f2ae3f7907f0a0ef43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:04.761274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6046884c8cf547f2ae3f7907f0a0ef43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:04.773959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6046884c8cf547f2ae3f7907f0a0ef43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:04.780868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6046884c8cf547f2ae3f7907f0a0ef43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:04.781514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6046884c8cf547f2ae3f7907f0a0ef43'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:04.787728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1315/2623] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:04 2022] DELETE /identity/v3/users/6046884c8cf547f2ae3f7907f0a0ef43 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:04.792507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:04.793018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:04.793126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:04.811285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:04.812485 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:04.875811 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1309/2624] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:04.885899 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:04.887636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:04.936675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:04.954133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03383b7-5ca9-4a40-8cd4-f420dca21af9 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:04.958793 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:04.959490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:04.959776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:04.960048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:04.969693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:04.971269 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:04.981188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1316/2625] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:05.339826 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:05.342387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:05.358609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb1562-cd28-4b2d-b953-607d29349b43 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:05.364559 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:05.365684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:05.365843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:05.366115 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] PATH_INFO: `/v3/projects/2f50fcbb0b2a4d2c95b2d9bf9ce4283a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:05.367497 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f50fcbb0b2a4d2c95b2d9bf9ce4283a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:05.369475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:05.424461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f50fcbb0b2a4d2c95b2d9bf9ce4283a', 'request_id': 'req-f4a9c846-6564-47cd-a06f-14c463800e16'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.430369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f50fcbb0b2a4d2c95b2d9bf9ce4283a', 'request_id': 'req-f4a9c846-6564-47cd-a06f-14c463800e16'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.437063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f50fcbb0b2a4d2c95b2d9bf9ce4283a', 'request_id': 'req-f4a9c846-6564-47cd-a06f-14c463800e16'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.451081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] The token cache is being invalidate because project 2f50fcbb0b2a4d2c95b2d9bf9ce4283a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:05.451435 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.452336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.454670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1310/2626] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:05 2022] DELETE /identity/v3/projects/2f50fcbb0b2a4d2c95b2d9bf9ce4283a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:05.459271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:05.469645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16273d-4e50-419e-8cc0-940c730018e3 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:05.529800 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:05.530735 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:05.531025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:05.531303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] PATH_INFO: `/v3/users/8934741b415544058c3498b0ccd61532` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:05.532498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8934741b415544058c3498b0ccd61532)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:05.534730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:05.583260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8934741b415544058c3498b0ccd61532'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.592508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8934741b415544058c3498b0ccd61532'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.610271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8934741b415544058c3498b0ccd61532'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.617426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8934741b415544058c3498b0ccd61532'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.618137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-8d2fd9a5-bde3-445b-a926-c978e1f1c2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8934741b415544058c3498b0ccd61532'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:05.624237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1317/2627] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:05 2022] DELETE /identity/v3/users/8934741b415544058c3498b0ccd61532 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:05.910351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:05.911782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:05.926574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9c846-6564-47cd-a06f-14c463800e16 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:05.990118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:05.991477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:05.991761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:05.992038 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] PATH_INFO: `/v3/projects/6af9603c929c4dcbbdf668ee4a3d853a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:05.993264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af9603c929c4dcbbdf668ee4a3d853a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:05.995268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.012661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:06.046857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af9603c929c4dcbbdf668ee4a3d853a', 'request_id': 'req-85093948-1abf-439f-aedc-c15506f766c0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:06.052723 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af9603c929c4dcbbdf668ee4a3d853a', 'request_id': 'req-85093948-1abf-439f-aedc-c15506f766c0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:06.059443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af9603c929c4dcbbdf668ee4a3d853a', 'request_id': 'req-85093948-1abf-439f-aedc-c15506f766c0'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:06.074835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] The token cache is being invalidate because project 6af9603c929c4dcbbdf668ee4a3d853a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:06.075256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:06.075928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-85093948-1abf-439f-aedc-c15506f766c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:06.077572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1311/2628] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:05 2022] DELETE /identity/v3/projects/6af9603c929c4dcbbdf668ee4a3d853a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:06.082785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341d12-2370-4aa9-b028-6ae3fd4361c0 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.083103 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341d12-2370-4aa9-b028-6ae3fd4361c0 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.083379 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341d12-2370-4aa9-b028-6ae3fd4361c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.102211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d2341d12-2370-4aa9-b028-6ae3fd4361c0 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:06.103480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d2341d12-2370-4aa9-b028-6ae3fd4361c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:06.166889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1318/2629] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:06.175842 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00782bdc-4cc4-4336-a1c9-5e9046b3aa6e None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.176121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00782bdc-4cc4-4336-a1c9-5e9046b3aa6e None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.176399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00782bdc-4cc4-4336-a1c9-5e9046b3aa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.194670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-00782bdc-4cc4-4336-a1c9-5e9046b3aa6e None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:06.195847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-00782bdc-4cc4-4336-a1c9-5e9046b3aa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:06.203771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1312/2630] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:06.208150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2341d12-2370-4aa9-b028-6ae3fd4361c0 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.213105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:06.219443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2341d12-2370-4aa9-b028-6ae3fd4361c0 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.224914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.225590 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.225981 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.226554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.227322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:33:06.227642 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.229634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.241830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1319/2631] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 17:33:06.246122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00782bdc-4cc4-4336-a1c9-5e9046b3aa6e None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.255791 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00782bdc-4cc4-4336-a1c9-5e9046b3aa6e None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.263277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.264075 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.264411 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.264720 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.265464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.267756 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.302142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1313/2632] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:33:06 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:06.306409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.318444 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ecdc0-4a42-4c43-8f2b-0ce042038992 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.375897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.376595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.376884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.377325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.378031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.380418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.402904 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1320/2633] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:33:06 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:06.407710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.418945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4ecee-fbc8-4207-a4ef-b32de9827b27 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.423698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.424440 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.424718 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.424992 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.425725 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.427400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.441031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1314/2634] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:06.444972 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.457696 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd10bc-9ae1-4823-a0d1-1c04ec65467e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.467826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2eee5-7d9c-4aaa-8bcd-5fa5fed03879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.468646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2eee5-7d9c-4aaa-8bcd-5fa5fed03879 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.469031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2eee5-7d9c-4aaa-8bcd-5fa5fed03879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.469406 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2eee5-7d9c-4aaa-8bcd-5fa5fed03879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.470280 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2eee5-7d9c-4aaa-8bcd-5fa5fed03879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.472537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2eee5-7d9c-4aaa-8bcd-5fa5fed03879 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.485832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1321/2635] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:33:06.490477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.500829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003b922-8ed4-49b5-97e1-25ff9b1eecbb admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.505469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.506402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.506682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.506951 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] PATH_INFO: `/v3/projects/8e1a6a1fd50645549f4b8e0291f0ec58/users/0643333465dd4d9b8daccd9a82acecff/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.524022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1a6a1fd50645549f4b8e0291f0ec58, user_id=0643333465dd4d9b8daccd9a82acecff, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.526748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.552956 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1315/2636] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:06 2022] PUT /identity/v3/projects/8e1a6a1fd50645549f4b8e0291f0ec58/users/0643333465dd4d9b8daccd9a82acecff/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:06.554869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424b75-3a2d-44ea-816c-427f16386b13 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.555359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424b75-3a2d-44ea-816c-427f16386b13 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.555510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424b75-3a2d-44ea-816c-427f16386b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.591610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-72424b75-3a2d-44ea-816c-427f16386b13 None None] MFA Rules not processed for user `0643333465dd4d9b8daccd9a82acecff`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:06.592885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-72424b75-3a2d-44ea-816c-427f16386b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:06.660387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1322/2637] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:06.664736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.741236 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815cf30-a7f1-4cdc-8c99-09207fef0c76 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.746540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.747232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.747517 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.747790 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.748479 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.750561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.782326 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1316/2638] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:33:06 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:06.785912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72424b75-3a2d-44ea-816c-427f16386b13 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.797566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72424b75-3a2d-44ea-816c-427f16386b13 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.850443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:06.858685 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.859528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.859852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.860193 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.861041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.863233 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.888134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1323/2639] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:33:06 2022] POST /identity/v3/users => generated 306 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:06.892063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.902661 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0399f75-672e-482a-a391-5b3d520acd13 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.907311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.907981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.908299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.908578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.909428 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.911080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.923185 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1317/2640] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:06.927780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.938486 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941488f0-9e9c-4c4c-a091-b7f0422500a1 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:06.943285 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:06.944165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:06.944456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:06.944726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] PATH_INFO: `/v3/projects/65c9b3aaa09447279e95fff8fb4ebdbe/users/33cf7f6eafaa420c93505d6f904f4224/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:06.959707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c9b3aaa09447279e95fff8fb4ebdbe, user_id=33cf7f6eafaa420c93505d6f904f4224, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:06.962387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:06.975868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1324/2641] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:06 2022] PUT /identity/v3/projects/65c9b3aaa09447279e95fff8fb4ebdbe/users/33cf7f6eafaa420c93505d6f904f4224/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:33:06.980663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:06.990822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676e591-052d-4452-8799-306276278ba4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:07.002601 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:07.052283 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2a941-be2b-4e28-bff9-f78acd1e3801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:07.053112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2a941-be2b-4e28-bff9-f78acd1e3801 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:07.053433 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2a941-be2b-4e28-bff9-f78acd1e3801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:07.053799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2a941-be2b-4e28-bff9-f78acd1e3801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:07.054571 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2a941-be2b-4e28-bff9-f78acd1e3801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:07.056391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2a941-be2b-4e28-bff9-f78acd1e3801 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:07.078685 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1318/2642] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 17:33:07.079365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:07.092336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edcc4d-c2bb-4884-98ac-063c431085ed admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:07.099349 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:07.100928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:07.101313 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:07.101585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] PATH_INFO: `/v3/projects/65c9b3aaa09447279e95fff8fb4ebdbe/users/33cf7f6eafaa420c93505d6f904f4224/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:07.103648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c9b3aaa09447279e95fff8fb4ebdbe, user_id=33cf7f6eafaa420c93505d6f904f4224, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:07.106768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:07.120101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1325/2643] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:07 2022] PUT /identity/v3/projects/65c9b3aaa09447279e95fff8fb4ebdbe/users/33cf7f6eafaa420c93505d6f904f4224/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:07.130495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42ebf8-62b6-4759-8eea-bf37ac4c1e34 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:07.130843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42ebf8-62b6-4759-8eea-bf37ac4c1e34 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:07.131079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42ebf8-62b6-4759-8eea-bf37ac4c1e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:07.159451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-bc42ebf8-62b6-4759-8eea-bf37ac4c1e34 None None] MFA Rules not processed for user `33cf7f6eafaa420c93505d6f904f4224`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:07.160708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-bc42ebf8-62b6-4759-8eea-bf37ac4c1e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:07.230804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1319/2644] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:07 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:07.242136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:07.243916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:07.300789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a69d6c-0c3e-45a9-93f9-64148bc69d84 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:07.304983 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12621469-c2b3-4ad4-8100-fb7bef29f4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:07.305621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621469-c2b3-4ad4-8100-fb7bef29f4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:07.305895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621469-c2b3-4ad4-8100-fb7bef29f4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:07.306165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12621469-c2b3-4ad4-8100-fb7bef29f4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:07.315884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621469-c2b3-4ad4-8100-fb7bef29f4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:07.317372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12621469-c2b3-4ad4-8100-fb7bef29f4f2 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:07.329688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1326/2645] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:07 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:07.401809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42ebf8-62b6-4759-8eea-bf37ac4c1e34 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:07.412743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42ebf8-62b6-4759-8eea-bf37ac4c1e34 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:07.416698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:07.417402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:07.417603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:07.417869 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:07.478366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:07.480211 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:07.489957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1320/2646] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:09.645543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e14d8-5add-4c93-9c7a-9f47cf9875c4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:09.646056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e14d8-5add-4c93-9c7a-9f47cf9875c4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:09.646056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e14d8-5add-4c93-9c7a-9f47cf9875c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:09.666361 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-520e14d8-5add-4c93-9c7a-9f47cf9875c4 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:09.667596 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-520e14d8-5add-4c93-9c7a-9f47cf9875c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:09.728577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1327/2647] 10.222.0.50 () {58 vars in 967 bytes} [Tue Jul 12 17:33:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:09.742132 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:09.743715 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:09.788289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:09.821561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b26bdb-35a1-4b6f-8257-e1ef735cd014 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:09.827670 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118128d-6f54-4e81-b61a-81adeb26599f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:09.828137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118128d-6f54-4e81-b61a-81adeb26599f service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:09.828421 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118128d-6f54-4e81-b61a-81adeb26599f service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:09.828696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118128d-6f54-4e81-b61a-81adeb26599f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:09.839406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118128d-6f54-4e81-b61a-81adeb26599f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:09.841021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118128d-6f54-4e81-b61a-81adeb26599f service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:09.850021 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1321/2648] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:33:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:33:11.638998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e14d8-5add-4c93-9c7a-9f47cf9875c4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:11.702715 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:11.711303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e14d8-5add-4c93-9c7a-9f47cf9875c4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:11.717916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:11.718849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:11.719130 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:11.719426 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] PATH_INFO: `/v3/users/0643333465dd4d9b8daccd9a82acecff` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:11.720846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0643333465dd4d9b8daccd9a82acecff)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:11.722830 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:11.775889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0643333465dd4d9b8daccd9a82acecff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:11.788178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0643333465dd4d9b8daccd9a82acecff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:11.801758 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0643333465dd4d9b8daccd9a82acecff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:11.809360 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0643333465dd4d9b8daccd9a82acecff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:11.810096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0643333465dd4d9b8daccd9a82acecff'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:11.820200 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1328/2649] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:11 2022] DELETE /identity/v3/users/0643333465dd4d9b8daccd9a82acecff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:11.825020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:11.825542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:11.825542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:11.843857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:11.845055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:11.912226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1322/2650] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:11.924656 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:11.926730 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:11.994163 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594f8f-739b-436a-a48f-c71858171cf8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:11.998316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:11.998988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:11.999270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:11.999546 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:12.010182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:12.012402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:12.024850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1329/2651] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:12.576687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:12.578227 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:12.591208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78da3f-282a-41d5-bece-4a12e4433e41 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:12.596554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:12.597443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:12.597735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:12.597972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] PATH_INFO: `/v3/projects/8e1a6a1fd50645549f4b8e0291f0ec58` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:12.599957 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1a6a1fd50645549f4b8e0291f0ec58)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:12.601920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:12.652775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1a6a1fd50645549f4b8e0291f0ec58', 'request_id': 'req-019f064b-b322-4c6c-a800-3497325fdcb9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.658581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1a6a1fd50645549f4b8e0291f0ec58', 'request_id': 'req-019f064b-b322-4c6c-a800-3497325fdcb9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.666133 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1a6a1fd50645549f4b8e0291f0ec58', 'request_id': 'req-019f064b-b322-4c6c-a800-3497325fdcb9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.681142 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] The token cache is being invalidate because project 8e1a6a1fd50645549f4b8e0291f0ec58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:12.681430 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.682086 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.683766 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1323/2652] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:12 2022] DELETE /identity/v3/projects/8e1a6a1fd50645549f4b8e0291f0ec58 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:12.687872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:12.698421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2c23-1698-4acf-9d29-535e0bb79d0a service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:12.762325 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:12.763154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:12.763430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:12.763702 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] PATH_INFO: `/v3/users/33cf7f6eafaa420c93505d6f904f4224` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:12.764960 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cf7f6eafaa420c93505d6f904f4224)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:12.766936 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:12.792177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:12.819898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cf7f6eafaa420c93505d6f904f4224'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.830780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cf7f6eafaa420c93505d6f904f4224'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.843639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cf7f6eafaa420c93505d6f904f4224'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.851069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cf7f6eafaa420c93505d6f904f4224'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.851775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2b1b01da-bb21-4be9-8bcf-56cdd49616f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cf7f6eafaa420c93505d6f904f4224'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:12.858725 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1330/2653] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:12 2022] DELETE /identity/v3/users/33cf7f6eafaa420c93505d6f904f4224 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:13.165319 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.167083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:13.182829 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f064b-b322-4c6c-a800-3497325fdcb9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:13.231837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:13.246757 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:13.247653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.247934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.248206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] PATH_INFO: `/v3/projects/65c9b3aaa09447279e95fff8fb4ebdbe` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.249457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c9b3aaa09447279e95fff8fb4ebdbe)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:13.251443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:13.300657 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c9b3aaa09447279e95fff8fb4ebdbe', 'request_id': 'req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:13.306257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c9b3aaa09447279e95fff8fb4ebdbe', 'request_id': 'req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:13.312489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c9b3aaa09447279e95fff8fb4ebdbe', 'request_id': 'req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:13.326202 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] The token cache is being invalidate because project 65c9b3aaa09447279e95fff8fb4ebdbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:13.326629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:13.327268 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-fc12dfa3-64a5-4fb9-a9f8-8c9d2881eb42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:13.332272 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1324/2654] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:13 2022] DELETE /identity/v3/projects/65c9b3aaa09447279e95fff8fb4ebdbe => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:13.334801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea9af-c610-42c4-a7e1-84a513132f19 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.335327 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea9af-c610-42c4-a7e1-84a513132f19 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.335618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea9af-c610-42c4-a7e1-84a513132f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.355711 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-190ea9af-c610-42c4-a7e1-84a513132f19 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:13.357050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-190ea9af-c610-42c4-a7e1-84a513132f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:13.421638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1331/2655] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:13.430727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b38a-7a19-403d-b4df-ce0e147645c8 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.431014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b38a-7a19-403d-b4df-ce0e147645c8 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.431281 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942b38a-7a19-403d-b4df-ce0e147645c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.452201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b942b38a-7a19-403d-b4df-ce0e147645c8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:13.453709 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b942b38a-7a19-403d-b4df-ce0e147645c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:13.470955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1325/2656] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:13.475654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ea9af-c610-42c4-a7e1-84a513132f19 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.486394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ea9af-c610-42c4-a7e1-84a513132f19 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:13.491996 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:13.492660 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.492948 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.493221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.493959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:33:13.494265 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:13.495890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:13.509207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1332/2657] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:33:13.513470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b38a-7a19-403d-b4df-ce0e147645c8 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.525200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942b38a-7a19-403d-b4df-ce0e147645c8 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:13.531967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:13.533298 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.533736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.534320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.536484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:13.538044 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:13.572731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1326/2658] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:33:13 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:13.575621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.586636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731906-7273-43e8-bae8-5cafbded04cd admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:13.647113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:13.647819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.648105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.648372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.649074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:13.651065 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:13.677951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1333/2659] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:33:13 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:13.679291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.689646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc386353-5770-43fb-90cb-c8f42c55ab41 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:13.694204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:13.694897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.695174 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.695446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.696172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:13.697768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:13.709501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1327/2660] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:13.714507 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.725248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341f12-0f49-486f-9e4b-c808d109e09a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:13.730452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd851-b836-4fb5-ac44-f501ec4b43b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:13.731116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd851-b836-4fb5-ac44-f501ec4b43b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.731397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd851-b836-4fb5-ac44-f501ec4b43b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.731668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd851-b836-4fb5-ac44-f501ec4b43b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.732474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd851-b836-4fb5-ac44-f501ec4b43b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:13.734245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd851-b836-4fb5-ac44-f501ec4b43b2 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:13.746930 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1334/2661] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:13.751237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.763491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be7e4-cc88-42ae-b948-3895ea95bccc admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:13.769383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:13.770314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.770608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.771746 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] PATH_INFO: `/v3/projects/b4e6c270eea145358f62a96a7084c3ed/users/f603bdd03bf349c3809c85803c71b99f/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.788570 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e6c270eea145358f62a96a7084c3ed, user_id=f603bdd03bf349c3809c85803c71b99f, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:13.791339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:13.807830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1328/2662] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:13 2022] PUT /identity/v3/projects/b4e6c270eea145358f62a96a7084c3ed/users/f603bdd03bf349c3809c85803c71b99f/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:33:13.818483 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b92535-139c-4f06-ae68-670cafeec95b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:13.818779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b92535-139c-4f06-ae68-670cafeec95b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:13.819058 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b92535-139c-4f06-ae68-670cafeec95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:13.827372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:13.852535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-38b92535-139c-4f06-ae68-670cafeec95b None None] MFA Rules not processed for user `f603bdd03bf349c3809c85803c71b99f`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:13.854374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-38b92535-139c-4f06-ae68-670cafeec95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:13.935621 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1335/2663] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:33:13.948126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:13.951159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:14.021831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946e709-d379-4329-b667-52479e37b4c6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:14.025900 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd3576-a80f-4ba6-be2d-65ecff379037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:14.026603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3576-a80f-4ba6-be2d-65ecff379037 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:14.026888 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3576-a80f-4ba6-be2d-65ecff379037 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:14.027162 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3576-a80f-4ba6-be2d-65ecff379037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:14.036582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd3576-a80f-4ba6-be2d-65ecff379037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:14.038493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd3576-a80f-4ba6-be2d-65ecff379037 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:14.047500 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1329/2664] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:19.479183 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b92535-139c-4f06-ae68-670cafeec95b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:19.545168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b92535-139c-4f06-ae68-670cafeec95b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:19.551577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:19.552878 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:19.553249 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:19.553587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] PATH_INFO: `/v3/users/f603bdd03bf349c3809c85803c71b99f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:19.555654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f603bdd03bf349c3809c85803c71b99f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:19.558526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:19.610102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f603bdd03bf349c3809c85803c71b99f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:19.617603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f603bdd03bf349c3809c85803c71b99f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:19.629907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f603bdd03bf349c3809c85803c71b99f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:19.636872 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f603bdd03bf349c3809c85803c71b99f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:19.637605 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f603bdd03bf349c3809c85803c71b99f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:19.644083 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1336/2665] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:19 2022] DELETE /identity/v3/users/f603bdd03bf349c3809c85803c71b99f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:19.651334 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:19.651841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:19.652027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:19.672494 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:19.673902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:19.687944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:19.740876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1330/2666] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:19.754389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:19.756214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:19.772418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:19.821589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ea0ca-af8f-4fd3-8b01-833673c513ee admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:19.826869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8181684-09f7-4954-a948-54da4cc1ec46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:19.827535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8181684-09f7-4954-a948-54da4cc1ec46 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:19.827823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8181684-09f7-4954-a948-54da4cc1ec46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:19.828098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8181684-09f7-4954-a948-54da4cc1ec46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:19.838063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8181684-09f7-4954-a948-54da4cc1ec46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:19.839543 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8181684-09f7-4954-a948-54da4cc1ec46 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:19.849759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1337/2667] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:20.161460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.163043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:20.182336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806893a-e72a-4f95-94d0-2c322f28614c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.188977 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.189998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.190355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.190541 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] PATH_INFO: `/v3/projects/b4e6c270eea145358f62a96a7084c3ed` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.191848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e6c270eea145358f62a96a7084c3ed)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.193821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.244084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e6c270eea145358f62a96a7084c3ed', 'request_id': 'req-da5adf90-2761-411e-8e4e-497571f548ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:20.250095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e6c270eea145358f62a96a7084c3ed', 'request_id': 'req-da5adf90-2761-411e-8e4e-497571f548ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:20.256299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e6c270eea145358f62a96a7084c3ed', 'request_id': 'req-da5adf90-2761-411e-8e4e-497571f548ea'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:20.270386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] The token cache is being invalidate because project b4e6c270eea145358f62a96a7084c3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:20.270678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:20.271336 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-da5adf90-2761-411e-8e4e-497571f548ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:20.272917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1331/2668] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:20 2022] DELETE /identity/v3/projects/b4e6c270eea145358f62a96a7084c3ed => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:20.278397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b71dd-5b54-4559-8be8-1bb2bd70cdc8 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.278777 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b71dd-5b54-4559-8be8-1bb2bd70cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.279051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b71dd-5b54-4559-8be8-1bb2bd70cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.298173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-f59b71dd-5b54-4559-8be8-1bb2bd70cdc8 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:20.299402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-f59b71dd-5b54-4559-8be8-1bb2bd70cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:20.363754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1338/2669] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:20.373193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c9cf-2595-4200-aea2-c552070757c6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.373484 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c9cf-2595-4200-aea2-c552070757c6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.373762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9c9cf-2595-4200-aea2-c552070757c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.393998 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-90e9c9cf-2595-4200-aea2-c552070757c6 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:20.395246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-90e9c9cf-2595-4200-aea2-c552070757c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:20.404904 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1332/2670] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:33:20.409319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b71dd-5b54-4559-8be8-1bb2bd70cdc8 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.419519 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b71dd-5b54-4559-8be8-1bb2bd70cdc8 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.424390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.425041 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.425322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.425603 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.426358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:33:20.426667 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.428283 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.440192 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1339/2671] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:33:20.444633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c9cf-2595-4200-aea2-c552070757c6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.454014 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9c9cf-2595-4200-aea2-c552070757c6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.458963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.459614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.459892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.460161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.460876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.462816 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.490345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1333/2672] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:33:20 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:20.496230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.511853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76589ba-3322-474e-a46f-fa150a591a52 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.573051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.573727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.574003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.574478 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.575066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.577117 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.600266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1340/2673] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:33:20 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:20.604324 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.615313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e209-4a59-4ee4-8572-31080faaf6c1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.620376 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.621040 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.621347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.621624 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.622391 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.623996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.635704 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1334/2674] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:20.640401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.657224 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b9c4d-2bc4-4db2-b78c-f1593c648652 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.661851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cd6bd-d654-4180-9e8d-6dc28c8a8b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.662587 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd6bd-d654-4180-9e8d-6dc28c8a8b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.662868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd6bd-d654-4180-9e8d-6dc28c8a8b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.663144 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cd6bd-d654-4180-9e8d-6dc28c8a8b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.663884 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd6bd-d654-4180-9e8d-6dc28c8a8b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.665515 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cd6bd-d654-4180-9e8d-6dc28c8a8b89 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.676759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1341/2675] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:20.681022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.692386 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9cc324-074a-488a-9cfb-d65d1c19aa91 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.698420 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.699312 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.700152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.700152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] PATH_INFO: `/v3/projects/5e7603a437df47b59e409b26fd24da66/users/2aadf51fb42943a692541f5f869d8ef9/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.716417 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7603a437df47b59e409b26fd24da66, user_id=2aadf51fb42943a692541f5f869d8ef9, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.719169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.739812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1335/2676] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:20 2022] PUT /identity/v3/projects/5e7603a437df47b59e409b26fd24da66/users/2aadf51fb42943a692541f5f869d8ef9/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:20.756965 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f279e6-8e2f-47b2-9c9f-d4af40adf08b None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.757473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f279e6-8e2f-47b2-9c9f-d4af40adf08b None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.758105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f279e6-8e2f-47b2-9c9f-d4af40adf08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.787833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-49f279e6-8e2f-47b2-9c9f-d4af40adf08b None None] MFA Rules not processed for user `2aadf51fb42943a692541f5f869d8ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:20.789046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-49f279e6-8e2f-47b2-9c9f-d4af40adf08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:20.799342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:20.860625 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1342/2677] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:20.865397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.909264 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:20.933263 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fccc7-1a80-4281-8a5a-324cdd8ecd55 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:20.938207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:20.938907 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:20.939190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:20.939465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:20.940161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:20.942060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:20.970993 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1336/2678] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:33:20 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:20.975294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f279e6-8e2f-47b2-9c9f-d4af40adf08b None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:20.987608 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f279e6-8e2f-47b2-9c9f-d4af40adf08b None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.056834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.057525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.057815 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.058094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.058943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.061289 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.087242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1343/2679] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:33:20 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:21.093823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.106558 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169aa39-c47b-4b1f-bdc3-81b5e4f85272 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.111639 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.112323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.112604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.112897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.113615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.115345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.128108 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1337/2680] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:21.132635 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.144701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3bfc7-bbf2-4bbe-94ce-971a5be41f95 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.150651 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41500df-e21d-4ab3-86dc-38366846b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.151524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41500df-e21d-4ab3-86dc-38366846b17d admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.151818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41500df-e21d-4ab3-86dc-38366846b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.152174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41500df-e21d-4ab3-86dc-38366846b17d admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.153643 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41500df-e21d-4ab3-86dc-38366846b17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.156244 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41500df-e21d-4ab3-86dc-38366846b17d admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.170897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1344/2681] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:21.174708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.189246 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0097f9-152a-4754-b8e5-916f9929ec73 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.194081 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.195128 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.195478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.195818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] PATH_INFO: `/v3/projects/b26c93af282b435890c04513dd4fdfd8/users/6022a17e9bed4790b060f6653994f2d8/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.212374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26c93af282b435890c04513dd4fdfd8, user_id=6022a17e9bed4790b060f6653994f2d8, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.215962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.235180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1338/2682] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:21 2022] PUT /identity/v3/projects/b26c93af282b435890c04513dd4fdfd8/users/6022a17e9bed4790b060f6653994f2d8/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:33:21.245347 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4993-fbfe-4cb0-aea3-b101a24464d3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.245636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4993-fbfe-4cb0-aea3-b101a24464d3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.245914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4993-fbfe-4cb0-aea3-b101a24464d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.273529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-5c3f4993-fbfe-4cb0-aea3-b101a24464d3 None None] MFA Rules not processed for user `6022a17e9bed4790b060f6653994f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:21.274791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5c3f4993-fbfe-4cb0-aea3-b101a24464d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:21.347801 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1345/2683] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:21.352540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.421441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3bf3b-371f-42cb-b57a-809d6af50d48 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.426383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.427065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.427338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.427611 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.428357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.430307 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.459452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1339/2684] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:33:21 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:33:21.463865 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4993-fbfe-4cb0-aea3-b101a24464d3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.475250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4993-fbfe-4cb0-aea3-b101a24464d3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.493597 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:21.539263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.540050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.540400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.540707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.541495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.544096 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.567115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1346/2685] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:33:21 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:33:21.571234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.582515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4969a-5e31-4c6f-ab58-b2cd1ca8df42 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.587470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.588151 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.588438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.588744 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.589474 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.591248 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.602158 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1340/2686] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:21.607688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.618227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a31d9-7038-45f2-99a4-9762ad2f6a18 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.625136 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.626026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.626332 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.626613 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] PATH_INFO: `/v3/projects/54a62a253be543cebb6e2b3e840aed7f/users/b024b2110afd4ed689b51c6046882146/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.644015 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a62a253be543cebb6e2b3e840aed7f, user_id=b024b2110afd4ed689b51c6046882146, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.648270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.666450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1347/2687] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:21 2022] PUT /identity/v3/projects/54a62a253be543cebb6e2b3e840aed7f/users/b024b2110afd4ed689b51c6046882146/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:33:21.671371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.682321 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81343a8-55e1-4cac-b0b1-545c57951153 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.751708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da863b0e-8b65-47f1-b5af-1ff79e71c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.752374 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da863b0e-8b65-47f1-b5af-1ff79e71c5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.752652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da863b0e-8b65-47f1-b5af-1ff79e71c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.752921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da863b0e-8b65-47f1-b5af-1ff79e71c5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.753626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da863b0e-8b65-47f1-b5af-1ff79e71c5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.755259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da863b0e-8b65-47f1-b5af-1ff79e71c5c2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.757280 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:21.768126 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1341/2688] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:33:21.772551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:21.785843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c037b-8632-42bb-85a7-7bf1dd15b1df admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:21.791147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:21.792032 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.792322 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.792599 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] PATH_INFO: `/v3/projects/54a62a253be543cebb6e2b3e840aed7f/users/b024b2110afd4ed689b51c6046882146/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.795164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54a62a253be543cebb6e2b3e840aed7f, user_id=b024b2110afd4ed689b51c6046882146, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:21.797824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:21.809232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1348/2689] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:33:21 2022] PUT /identity/v3/projects/54a62a253be543cebb6e2b3e840aed7f/users/b024b2110afd4ed689b51c6046882146/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:21.879834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2917c-9f5e-43f6-aa8f-e1df479e2541 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:21.880191 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2917c-9f5e-43f6-aa8f-e1df479e2541 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:21.880565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2917c-9f5e-43f6-aa8f-e1df479e2541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:21.917414 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cdf2917c-9f5e-43f6-aa8f-e1df479e2541 None None] MFA Rules not processed for user `b024b2110afd4ed689b51c6046882146`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:21.919464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cdf2917c-9f5e-43f6-aa8f-e1df479e2541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:21.993980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1342/2690] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:22.006229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:22.008219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:22.084522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cbd44-b8e4-441b-85f1-a1e16a505519 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:22.088671 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f80b02-c839-4a86-bdfd-b2f7e5bf3093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:22.089320 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80b02-c839-4a86-bdfd-b2f7e5bf3093 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:22.089604 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80b02-c839-4a86-bdfd-b2f7e5bf3093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:22.089868 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f80b02-c839-4a86-bdfd-b2f7e5bf3093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:22.162074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80b02-c839-4a86-bdfd-b2f7e5bf3093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:22.163570 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f80b02-c839-4a86-bdfd-b2f7e5bf3093 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:22.173421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1349/2691] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:23.680615 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2917c-9f5e-43f6-aa8f-e1df479e2541 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:23.691519 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2917c-9f5e-43f6-aa8f-e1df479e2541 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:23.695574 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:23.696228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:23.696508 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:23.696779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:23.758688 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:23.760244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:23.771169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1343/2692] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:33:23.944463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b01a7-dbbc-45d2-a05f-7103b6503db2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:23.945028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b01a7-dbbc-45d2-a05f-7103b6503db2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:23.945028 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b01a7-dbbc-45d2-a05f-7103b6503db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:23.963631 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0d8b01a7-dbbc-45d2-a05f-7103b6503db2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:23.964968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0d8b01a7-dbbc-45d2-a05f-7103b6503db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:23.991407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:24.037380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1350/2693] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:24.066686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:24.068531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:24.150424 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82e1eb-311e-4331-a32b-f8ee402c8fda service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:24.156989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19733c21-c84e-487c-9b80-1927c4303327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:24.158071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19733c21-c84e-487c-9b80-1927c4303327 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:24.158613 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19733c21-c84e-487c-9b80-1927c4303327 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:24.158893 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19733c21-c84e-487c-9b80-1927c4303327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:24.170167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19733c21-c84e-487c-9b80-1927c4303327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:24.171874 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19733c21-c84e-487c-9b80-1927c4303327 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:24.182328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1344/2694] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:24.327985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b01a7-dbbc-45d2-a05f-7103b6503db2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:24.337987 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b01a7-dbbc-45d2-a05f-7103b6503db2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:24.342756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:24.343488 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:24.343952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:24.344229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:24.356571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:24.358098 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:24.369262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1351/2695] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:27.006396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b172c-a4e4-45fc-811f-575af3f0aeee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:27.006899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b172c-a4e4-45fc-811f-575af3f0aeee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:27.007012 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b172c-a4e4-45fc-811f-575af3f0aeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:27.019793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:27.026121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-298b172c-a4e4-45fc-811f-575af3f0aeee None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:27.027350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-298b172c-a4e4-45fc-811f-575af3f0aeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:27.035881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1345/2696] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:33:27.060247 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:27.061947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:27.078453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec646fd7-e4cf-4280-b355-f6e58e249a00 service cinder] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:27.084568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf193f88-011d-4035-b942-2956301844dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:27.085228 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193f88-011d-4035-b942-2956301844dd service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:27.085511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193f88-011d-4035-b942-2956301844dd service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:27.085794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf193f88-011d-4035-b942-2956301844dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:27.095539 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf193f88-011d-4035-b942-2956301844dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:27.097261 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf193f88-011d-4035-b942-2956301844dd service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:27.109648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1352/2697] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:28.239823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b172c-a4e4-45fc-811f-575af3f0aeee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:28.254885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b172c-a4e4-45fc-811f-575af3f0aeee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:28.261527 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:28.262763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:28.263140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:28.263470 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] PATH_INFO: `/v3/users/2aadf51fb42943a692541f5f869d8ef9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:28.265289 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aadf51fb42943a692541f5f869d8ef9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:28.267262 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:28.321684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aadf51fb42943a692541f5f869d8ef9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.322346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aadf51fb42943a692541f5f869d8ef9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.322968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aadf51fb42943a692541f5f869d8ef9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.329884 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aadf51fb42943a692541f5f869d8ef9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.341425 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aadf51fb42943a692541f5f869d8ef9'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.360122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1346/2698] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:28 2022] DELETE /identity/v3/users/2aadf51fb42943a692541f5f869d8ef9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:28.365453 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:28.365940 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:28.366066 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:28.387273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:28.388477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:28.450719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1353/2699] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:28.464104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:28.466573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:28.527332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725d4af-e602-4caf-b557-ad4a7ae1d74d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:28.532592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:28.533286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:28.533565 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:28.533837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:28.544361 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:28.545809 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:28.555641 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1347/2700] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:28.836295 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:28.837802 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:28.850000 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a75a8-353b-4787-bdcf-0f80429b172c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:28.855225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:28.856102 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:28.856402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:28.856679 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] PATH_INFO: `/v3/projects/5e7603a437df47b59e409b26fd24da66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:28.858927 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7603a437df47b59e409b26fd24da66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:28.860923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:28.910485 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7603a437df47b59e409b26fd24da66', 'request_id': 'req-eadf18c5-85e8-417e-bf16-aee6065f10da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.919555 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7603a437df47b59e409b26fd24da66', 'request_id': 'req-eadf18c5-85e8-417e-bf16-aee6065f10da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.927435 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7603a437df47b59e409b26fd24da66', 'request_id': 'req-eadf18c5-85e8-417e-bf16-aee6065f10da'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.939124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] The token cache is being invalidate because project 5e7603a437df47b59e409b26fd24da66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:28.939411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.940089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:28.941675 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1354/2701] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:28 2022] DELETE /identity/v3/projects/5e7603a437df47b59e409b26fd24da66 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:28.945789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:28.956003 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2447641-45a7-4944-bc43-5a80366b7f07 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:29.016947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:29.017762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:29.018045 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:29.018351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] PATH_INFO: `/v3/users/6022a17e9bed4790b060f6653994f2d8` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:29.019543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6022a17e9bed4790b060f6653994f2d8)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:29.021493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:29.037130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:29.070696 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6022a17e9bed4790b060f6653994f2d8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.071347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6022a17e9bed4790b060f6653994f2d8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.071959 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6022a17e9bed4790b060f6653994f2d8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.078926 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6022a17e9bed4790b060f6653994f2d8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.091084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6022a17e9bed4790b060f6653994f2d8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.107187 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1348/2702] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:28 2022] DELETE /identity/v3/users/6022a17e9bed4790b060f6653994f2d8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:29.393820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:29.395288 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:29.408724 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf18c5-85e8-417e-bf16-aee6065f10da admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:29.429097 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:29.472450 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:29.473989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:29.474370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:29.474578 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] PATH_INFO: `/v3/projects/b26c93af282b435890c04513dd4fdfd8` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:29.475834 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26c93af282b435890c04513dd4fdfd8)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:29.477779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:29.536043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26c93af282b435890c04513dd4fdfd8', 'request_id': 'req-41c2c6dd-2451-4289-bf00-072c9d7a3d75'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.545961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26c93af282b435890c04513dd4fdfd8', 'request_id': 'req-41c2c6dd-2451-4289-bf00-072c9d7a3d75'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.552812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26c93af282b435890c04513dd4fdfd8', 'request_id': 'req-41c2c6dd-2451-4289-bf00-072c9d7a3d75'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.564929 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] The token cache is being invalidate because project b26c93af282b435890c04513dd4fdfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:29.565218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.565875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.567495 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1355/2703] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:29 2022] DELETE /identity/v3/projects/b26c93af282b435890c04513dd4fdfd8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:29.571749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:29.573250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:29.587583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f304940-8dde-4460-8210-37e6ef550032 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:29.647968 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:29.648892 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:29.649172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:29.649448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] PATH_INFO: `/v3/users/b024b2110afd4ed689b51c6046882146` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:29.650712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b024b2110afd4ed689b51c6046882146)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:29.652737 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:29.709597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b024b2110afd4ed689b51c6046882146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.710308 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b024b2110afd4ed689b51c6046882146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.711024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b024b2110afd4ed689b51c6046882146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.718259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b024b2110afd4ed689b51c6046882146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.734867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f3717603-c883-487c-b626-753a910fbde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b024b2110afd4ed689b51c6046882146'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:29.750138 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1349/2704] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:33:29 2022] DELETE /identity/v3/users/b024b2110afd4ed689b51c6046882146 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:33:30.047992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:30.049516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:30.064473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2c6dd-2451-4289-bf00-072c9d7a3d75 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:30.127350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:30.128146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:30.128428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:30.128701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] PATH_INFO: `/v3/projects/54a62a253be543cebb6e2b3e840aed7f` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:30.129919 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54a62a253be543cebb6e2b3e840aed7f)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:30.131883 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:30.181736 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54a62a253be543cebb6e2b3e840aed7f', 'request_id': 'req-58e96f6f-940f-4902-a117-4ca289456982'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:30.191482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54a62a253be543cebb6e2b3e840aed7f', 'request_id': 'req-58e96f6f-940f-4902-a117-4ca289456982'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:30.193738 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:30.202248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54a62a253be543cebb6e2b3e840aed7f', 'request_id': 'req-58e96f6f-940f-4902-a117-4ca289456982'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:30.216107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] The token cache is being invalidate because project 54a62a253be543cebb6e2b3e840aed7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:33:30.216577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:30.217496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:33:30.219182 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1356/2705] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:33:30 2022] DELETE /identity/v3/projects/54a62a253be543cebb6e2b3e840aed7f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:33:32.344297 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6119d0-8968-444d-be83-eaec43c5d126 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:32.344867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6119d0-8968-444d-be83-eaec43c5d126 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:32.344867 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6119d0-8968-444d-be83-eaec43c5d126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:32.365518 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-cc6119d0-8968-444d-be83-eaec43c5d126 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:32.367367 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-cc6119d0-8968-444d-be83-eaec43c5d126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:32.379687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:32.435944 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1350/2706] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:32.466432 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:32.467963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:32.544121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e96f6f-940f-4902-a117-4ca289456982 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:32.550733 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:32.551422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:32.551707 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:32.551977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:32.561064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:32.562705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:32.572810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1357/2707] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:35.482436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c59d-96e2-4af0-ba6e-fca8b8d2c801 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:35.483028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c59d-96e2-4af0-ba6e-fca8b8d2c801 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:35.483028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69c59d-96e2-4af0-ba6e-fca8b8d2c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:35.502631 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-de69c59d-96e2-4af0-ba6e-fca8b8d2c801 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:35.503847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-de69c59d-96e2-4af0-ba6e-fca8b8d2c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:35.513483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1351/2708] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:35.560128 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:35.562844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:35.585999 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eadee-3e15-487e-a5d5-45254d53abcf service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:35.593308 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:35.593975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:35.594257 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:35.594563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:35.604817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:35.606517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:35.616831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1358/2709] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:38.649331 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd57b1-2a14-4a22-b707-d1f13c5b7caf None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:38.649967 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd57b1-2a14-4a22-b707-d1f13c5b7caf None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:38.650124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd57b1-2a14-4a22-b707-d1f13c5b7caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:38.675544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-50dd57b1-2a14-4a22-b707-d1f13c5b7caf None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:38.677139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-50dd57b1-2a14-4a22-b707-d1f13c5b7caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:38.687129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1352/2710] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:38.714951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:38.726846 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ee07c-93cf-4944-8abc-928096793be2 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:38.734149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:38.734837 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:38.735123 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:38.735408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:38.744166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:38.745843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:38.755531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1359/2711] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:41.832121 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869cf42-9627-406b-88df-7eddef2879e4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:41.832673 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869cf42-9627-406b-88df-7eddef2879e4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:41.832779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869cf42-9627-406b-88df-7eddef2879e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:41.858060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1869cf42-9627-406b-88df-7eddef2879e4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:41.859768 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1869cf42-9627-406b-88df-7eddef2879e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:41.872087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1353/2712] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:41.896245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:41.908324 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981245f2-5b2b-4862-9ac6-d11d01334de8 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:41.915281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:41.915931 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:41.916211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:41.916512 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:41.925210 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:41.926839 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:41.936626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1360/2713] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:51.848898 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=30 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:51.932480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=2,keystone:SELECT=57 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:33:53.424234 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869cf42-9627-406b-88df-7eddef2879e4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:53.440368 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869cf42-9627-406b-88df-7eddef2879e4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:53.447441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405f996-dad9-4612-bf44-ea5bddf78287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:53.448542 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f996-dad9-4612-bf44-ea5bddf78287 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:53.449019 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f996-dad9-4612-bf44-ea5bddf78287 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:53.449482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f996-dad9-4612-bf44-ea5bddf78287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:53.452178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-3405f996-dad9-4612-bf44-ea5bddf78287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:53.468702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405f996-dad9-4612-bf44-ea5bddf78287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:53.470543 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405f996-dad9-4612-bf44-ea5bddf78287 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:53.483909 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1354/2714] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:57.938698 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:57.940501 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:58.016011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10ca07-a2cb-485d-a7f9-4b9afca8ba39 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:58.021207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:58.021864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:58.022151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:58.022482 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:58.024509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:58.037791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:58.039384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:58.049382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1361/2715] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:33:58.277160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:58.277759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:58.277759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:58.297532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] MFA Rules not processed for user `4e8d7247460345229cc12a2fe1d33510`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:33:58.298789 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:58.361694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1355/2716] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:33:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:33:58.606808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:33:58.608338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:58.619534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3e66f-2226-48d5-8689-9bed58b6a175 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:33:58.623468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:33:58.624113 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:33:58.624391 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:33:58.624658 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:33:58.626593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:33:58.636989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:33:58.638757 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:33:58.647669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1362/2717] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:33:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:01.860633 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:01.862301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:01.922588 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:01.924045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:01.956735 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28efd10-b98b-4e1f-9b2c-82766c741a19 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:01.960776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e494a-6fc1-4748-8bed-74018d3bd6ee None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:01.961857 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:01.962926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:01.963270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:01.963752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] PATH_INFO: `/v3/users/7e5a33e74f604488b83efeec71ca7981` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:01.965204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5a33e74f604488b83efeec71ca7981)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:01.967254 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:01.967934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:01.968750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:01.969111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:01.969561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:01.972189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:01.992349 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:01.993970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.008197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1356/2718] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:02.040309 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5a33e74f604488b83efeec71ca7981'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.049615 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5a33e74f604488b83efeec71ca7981'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.068178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5a33e74f604488b83efeec71ca7981'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.075217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5a33e74f604488b83efeec71ca7981'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.075943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-b637f953-c851-44c8-a7d6-ed1fb17b27bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5a33e74f604488b83efeec71ca7981'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.082551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1363/2719] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:34:01 2022] DELETE /identity/v3/users/7e5a33e74f604488b83efeec71ca7981 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:34:02.265245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:02.277804 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0bbb4-a822-4660-835f-98cc0ab3fdad service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:02.340742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:02.341659 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.341950 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.342230 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] PATH_INFO: `/v3/projects/c8acacb90c2649c09bf8b096e4a9f096` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.343464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8acacb90c2649c09bf8b096e4a9f096)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:02.345398 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.371865 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:02.396905 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8acacb90c2649c09bf8b096e4a9f096', 'request_id': 'req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.402795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8acacb90c2649c09bf8b096e4a9f096', 'request_id': 'req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.409129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8acacb90c2649c09bf8b096e4a9f096', 'request_id': 'req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.421883 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] The token cache is being invalidate because project c8acacb90c2649c09bf8b096e4a9f096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:34:02.422165 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.422794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9119acf7-2cc8-4ed8-ae93-c44a5d085fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:02.424406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1357/2720] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:34:02 2022] DELETE /identity/v3/projects/c8acacb90c2649c09bf8b096e4a9f096 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:34:02.430107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8189c-52ce-4d24-886a-b4ff758f69ff None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.430419 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8189c-52ce-4d24-886a-b4ff758f69ff None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.430694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8189c-52ce-4d24-886a-b4ff758f69ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.449026 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-edb8189c-52ce-4d24-886a-b4ff758f69ff None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:02.450394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-edb8189c-52ce-4d24-886a-b4ff758f69ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:02.517669 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1364/2721] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:02.526168 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742af7b-629d-4d85-96b7-77ee7aad99d3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.526581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742af7b-629d-4d85-96b7-77ee7aad99d3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.526952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742af7b-629d-4d85-96b7-77ee7aad99d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.547074 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d742af7b-629d-4d85-96b7-77ee7aad99d3 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:02.548400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d742af7b-629d-4d85-96b7-77ee7aad99d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:02.558116 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1358/2722] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:02.562745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8189c-52ce-4d24-886a-b4ff758f69ff None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:02.568513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:02.573764 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8189c-52ce-4d24-886a-b4ff758f69ff None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:02.580518 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:02.582038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.582746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.583371 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.585095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:34:02.585095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:02.586655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.604376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1365/2723] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:34:02.608972 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742af7b-629d-4d85-96b7-77ee7aad99d3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:02.619578 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742af7b-629d-4d85-96b7-77ee7aad99d3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:02.624469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:02.625172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.625457 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.625735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.626489 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:02.629245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.656046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1359/2724] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:34:02 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:34:02.660508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:02.675250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fae76e-4497-4753-bfb9-22c2f2d8e430 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:02.745256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:02.745924 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.746203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.746491 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.747177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:02.749121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.769348 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1366/2725] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:34:02 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:34:02.773515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:02.783913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd6269-89e9-4247-bd30-1a84a2f0e346 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:02.789539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:02.790195 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.790495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.790792 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.791513 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:02.793103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.803970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1360/2726] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:34:02.808008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:02.819070 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765c18b-6ce5-4495-b2aa-0b9c1dbc9c08 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:02.824490 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0a032-dbad-4a15-8844-a73fd4e53b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:02.825129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0a032-dbad-4a15-8844-a73fd4e53b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.825411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0a032-dbad-4a15-8844-a73fd4e53b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.825686 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0a032-dbad-4a15-8844-a73fd4e53b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.826462 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0a032-dbad-4a15-8844-a73fd4e53b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:02.828081 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0a032-dbad-4a15-8844-a73fd4e53b98 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.838841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1367/2727] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:34:02.843327 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:02.854931 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a86884-e12f-4bdd-a320-875d840abae6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:02.860841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:02.861731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.862018 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.862310 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] PATH_INFO: `/v3/projects/e025435b30094ffea4dbd72bbafb9c3a/users/84331f5a01b74afa97dd200bbd4b4a51/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.879498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e025435b30094ffea4dbd72bbafb9c3a, user_id=84331f5a01b74afa97dd200bbd4b4a51, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:02.882247 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:02.897065 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1361/2728] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:34:02 2022] PUT /identity/v3/projects/e025435b30094ffea4dbd72bbafb9c3a/users/84331f5a01b74afa97dd200bbd4b4a51/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:34:02.903301 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e85ba-b944-4c91-8a3d-cda8fcb3f51a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:02.903766 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e85ba-b944-4c91-8a3d-cda8fcb3f51a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:02.904209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e85ba-b944-4c91-8a3d-cda8fcb3f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:02.925606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-0f8e85ba-b944-4c91-8a3d-cda8fcb3f51a None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:02.926875 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-0f8e85ba-b944-4c91-8a3d-cda8fcb3f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:02.996168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1368/2729] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:03.007525 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:03.009347 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:03.078655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70128ef5-203c-4ff1-b822-aec77f81f78a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:03.085953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:03.086711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:03.087022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:03.087286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:03.100490 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:03.101954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:03.112446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1362/2730] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:07.264161 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec463462-6411-4b57-8553-2a0285e99805 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:07.264740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec463462-6411-4b57-8553-2a0285e99805 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:07.264740 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec463462-6411-4b57-8553-2a0285e99805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:07.292428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ec463462-6411-4b57-8553-2a0285e99805 None None] MFA Rules not processed for user `84331f5a01b74afa97dd200bbd4b4a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:07.293564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ec463462-6411-4b57-8553-2a0285e99805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:07.361092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:07.372203 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1369/2731] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:07.388005 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:07.391383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:07.450589 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:07.482059 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e932d-7d08-45fe-9eb4-f32b722e15b1 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:07.490063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d75e86-8447-45e2-834b-e8c72302d66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:07.490970 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d75e86-8447-45e2-834b-e8c72302d66b service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:07.492351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d75e86-8447-45e2-834b-e8c72302d66b service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:07.492668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d75e86-8447-45e2-834b-e8c72302d66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:07.501576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d75e86-8447-45e2-834b-e8c72302d66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:07.505113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d75e86-8447-45e2-834b-e8c72302d66b service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:07.516509 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1363/2732] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:09.000311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39204-3c72-417b-8248-963ddddc8ef4 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:09.000817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39204-3c72-417b-8248-963ddddc8ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:09.000934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd39204-3c72-417b-8248-963ddddc8ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:09.020716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9bd39204-3c72-417b-8248-963ddddc8ef4 None None] MFA Rules not processed for user `84331f5a01b74afa97dd200bbd4b4a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:09.021955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9bd39204-3c72-417b-8248-963ddddc8ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:09.029720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1370/2733] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:14.075328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95db31-5c58-4ed1-8694-7a4f29a78e04 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:14.075758 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95db31-5c58-4ed1-8694-7a4f29a78e04 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:14.075877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95db31-5c58-4ed1-8694-7a4f29a78e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:14.101919 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6c95db31-5c58-4ed1-8694-7a4f29a78e04 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:14.103863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6c95db31-5c58-4ed1-8694-7a4f29a78e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:14.114094 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1364/2734] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:14.139118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39204-3c72-417b-8248-963ddddc8ef4 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:14.157893 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd39204-3c72-417b-8248-963ddddc8ef4 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:14.164708 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:14.165383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:14.165664 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:14.165938 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:14.177897 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:14.179585 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:14.190056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1371/2735] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:17.347623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8ff3-4930-47d3-af0d-6dd315bf233d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:17.348240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8ff3-4930-47d3-af0d-6dd315bf233d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:17.348240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8ff3-4930-47d3-af0d-6dd315bf233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:17.369686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-506f8ff3-4930-47d3-af0d-6dd315bf233d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:17.370940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-506f8ff3-4930-47d3-af0d-6dd315bf233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:17.380512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1365/2736] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:17.422471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:17.437146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766db490-428a-4976-bc1c-9867c8a5ac67 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:17.446967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:17.447864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:17.448176 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:17.448522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:17.461146 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:17.463003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:17.474963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1372/2737] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:20.441775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8a76-fac9-4f47-b523-1ff9a6c4a70d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:20.442274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8a76-fac9-4f47-b523-1ff9a6c4a70d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:20.442426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b8a76-fac9-4f47-b523-1ff9a6c4a70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:20.461697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-ad5b8a76-fac9-4f47-b523-1ff9a6c4a70d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:20.463053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ad5b8a76-fac9-4f47-b523-1ff9a6c4a70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:20.471795 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1366/2738] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:20.502418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:20.503963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:20.519509 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937dd6-8de8-4b09-a0ee-17e665ace7fc service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:20.526374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:20.527082 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:20.527484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:20.527761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:20.537270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:20.539059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:20.549814 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1373/2739] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:23.640597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6abd4-49ff-480f-a052-2ac45f340b33 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:23.641080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6abd4-49ff-480f-a052-2ac45f340b33 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:23.641164 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6abd4-49ff-480f-a052-2ac45f340b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:23.662985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-0eb6abd4-49ff-480f-a052-2ac45f340b33 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:23.664205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0eb6abd4-49ff-480f-a052-2ac45f340b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:23.673980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1367/2740] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:23.695430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:23.708820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe850a18-3d44-42fd-849b-62c235bd31f9 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:23.717946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:23.718653 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:23.718933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:23.719207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:23.730513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:23.732109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:23.742550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1374/2741] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:26.781515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:26.782092 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:26.782313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:26.804731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:26.806662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:26.819419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1368/2742] 10.222.0.64 () {58 vars in 1016 bytes} [Tue Jul 12 17:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:26.846409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:26.861807 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713d6bf-1006-49db-a850-48ea57f0601b service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:26.871975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:26.872932 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:26.873331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:26.873727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:26.887187 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:26.888808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:26.899820 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1375/2743] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:34:36.796891 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=26 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:36.894503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=34 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:55.144920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:55.146616 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:55.161532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c096050-3fa2-4c75-bdbf-6169d0a097fd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:55.166752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:55.167736 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.168015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.168285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] PATH_INFO: `/v3/users/4e8d7247460345229cc12a2fe1d33510` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.169620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8d7247460345229cc12a2fe1d33510)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:55.171546 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:55.219748 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8d7247460345229cc12a2fe1d33510'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.220461 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8d7247460345229cc12a2fe1d33510'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.221144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8d7247460345229cc12a2fe1d33510'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.229062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8d7247460345229cc12a2fe1d33510'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.240773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-a08c24ca-773e-4293-8c0b-bb8673132de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8d7247460345229cc12a2fe1d33510'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.256760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1369/2744] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:34:55 2022] DELETE /identity/v3/users/4e8d7247460345229cc12a2fe1d33510 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:34:55.444317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:55.454812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3dedb-6983-4984-8135-ddd752303659 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:55.517440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:55.518357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.518641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.518911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] PATH_INFO: `/v3/projects/91aec388436049408f13cf2d912655c0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.520188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91aec388436049408f13cf2d912655c0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:55.522160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:55.569974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91aec388436049408f13cf2d912655c0', 'request_id': 'req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.579343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91aec388436049408f13cf2d912655c0', 'request_id': 'req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.585460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91aec388436049408f13cf2d912655c0', 'request_id': 'req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.596979 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] The token cache is being invalidate because project 91aec388436049408f13cf2d912655c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:34:55.597266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.597926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-caaf9cd1-0d9d-4dd6-b4ff-0c207b2365dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:34:55.600050 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1376/2745] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:34:55 2022] DELETE /identity/v3/projects/91aec388436049408f13cf2d912655c0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:34:55.605260 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eebd6-9994-4510-9bcb-e82658665865 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.605548 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eebd6-9994-4510-9bcb-e82658665865 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.605821 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eebd6-9994-4510-9bcb-e82658665865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.625237 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-6d7eebd6-9994-4510-9bcb-e82658665865 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:55.626399 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d7eebd6-9994-4510-9bcb-e82658665865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:55.687523 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1370/2746] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:55.695455 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8cb3-bc2d-4535-a5fc-c45c57c8c666 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.695746 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8cb3-bc2d-4535-a5fc-c45c57c8c666 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.696021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f8cb3-bc2d-4535-a5fc-c45c57c8c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.716166 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b94f8cb3-bc2d-4535-a5fc-c45c57c8c666 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:55.717368 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b94f8cb3-bc2d-4535-a5fc-c45c57c8c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:55.725749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1377/2747] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:55.731179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eebd6-9994-4510-9bcb-e82658665865 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:55.741836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eebd6-9994-4510-9bcb-e82658665865 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:55.747229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:55.747894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.748176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.748449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.749188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:34:55.749495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:55.751156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:55.763468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1371/2748] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:34:55.768147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f8cb3-bc2d-4535-a5fc-c45c57c8c666 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:55.778042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f8cb3-bc2d-4535-a5fc-c45c57c8c666 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:55.785673 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:55.786712 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.787075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.787454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.788456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:55.791217 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:55.819268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1378/2749] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:34:55 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:34:55.823698 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:55.834394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf034-2a49-4e4f-971e-aef985153ae6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:55.893632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:55.894213 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.894520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.894787 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.895469 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:55.897378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:55.904135 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:55.921313 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1372/2750] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:34:55 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:34:55.926923 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:55.937790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b68ab2-090a-4529-be52-fc5e7979027b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:55.942890 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:55.943559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.943842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.944121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.944853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:55.946517 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:55.957547 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1379/2751] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:34:55.961566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:55.972646 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad0114-44df-4b52-bfa4-81f52cde0309 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:55.978996 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee160af8-9e1c-492f-81c9-329df174c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:55.979702 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160af8-9e1c-492f-81c9-329df174c178 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:55.979982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160af8-9e1c-492f-81c9-329df174c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:55.980257 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160af8-9e1c-492f-81c9-329df174c178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:55.980989 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee160af8-9e1c-492f-81c9-329df174c178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:55.982649 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee160af8-9e1c-492f-81c9-329df174c178 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:55.993261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1373/2752] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:34:55.997601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:56.008833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2026a-9f41-423c-bee7-87a738e712d4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:56.014995 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:56.015914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:56.016209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:56.016474 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] PATH_INFO: `/v3/projects/6e696ad988884d008e358fd00fd3a2e3/users/45eff53f0e6c4ac499d163c36b43dafd/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:56.033236 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e696ad988884d008e358fd00fd3a2e3, user_id=45eff53f0e6c4ac499d163c36b43dafd, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:56.035944 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:56.051059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1380/2753] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:34:55 2022] PUT /identity/v3/projects/6e696ad988884d008e358fd00fd3a2e3/users/45eff53f0e6c4ac499d163c36b43dafd/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:34:56.056477 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafff43-0c73-4c20-a51f-e66f5fef5e91 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:56.056771 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafff43-0c73-4c20-a51f-e66f5fef5e91 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:56.057137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafff43-0c73-4c20-a51f-e66f5fef5e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:56.075370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9eafff43-0c73-4c20-a51f-e66f5fef5e91 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:34:56.076575 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9eafff43-0c73-4c20-a51f-e66f5fef5e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:56.137438 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1374/2754] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:34:56.150522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:34:56.152727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:34:56.186178 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:34:56.219933 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c5e49-dcb8-4420-ade9-3cfa90992734 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:34:56.225132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:34:56.225790 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:34:56.226073 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:34:56.226382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:34:56.237104 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:34:56.238571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:34:56.248752 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1381/2755] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:35:00.354145 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472fcf-33c9-4e1c-acdf-8b10496066d5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:00.354928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472fcf-33c9-4e1c-acdf-8b10496066d5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:00.354928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da472fcf-33c9-4e1c-acdf-8b10496066d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:00.381739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-da472fcf-33c9-4e1c-acdf-8b10496066d5 None None] MFA Rules not processed for user `45eff53f0e6c4ac499d163c36b43dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:35:00.383047 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-da472fcf-33c9-4e1c-acdf-8b10496066d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:35:00.451437 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1375/2756] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:35:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:35:00.455900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:00.466638 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96662-3073-43dc-84ac-a53660065945 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:00.471961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:00.472634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:00.473071 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:00.473346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:00.474047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:00.476059 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:00.508075 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1382/2757] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:35:00 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:35:00.512309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da472fcf-33c9-4e1c-acdf-8b10496066d5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:00.524232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da472fcf-33c9-4e1c-acdf-8b10496066d5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:00.603022 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:00.603301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:00.603549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:00.603947 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:00.604666 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:00.607130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:00.626060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:00.641064 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1376/2758] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:35:00 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:35:00.642237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:00.653263 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5bfd-a8d8-4f62-adcf-877ccf8b4cc7 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:00.657907 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:00.658645 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:00.658953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:00.659206 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:00.659946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:00.661565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:00.673296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1383/2759] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:35:00.678845 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:00.689763 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625545f-4efd-4391-a3e3-d26f6e9f5a8e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:00.694751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:00.695761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:00.696109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:00.696475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] PATH_INFO: `/v3/projects/18ec6d2fa3a94ad6a161def80385db05/users/4b1b597d3dcd450db9e2691b38b37f77/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:00.720830 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ec6d2fa3a94ad6a161def80385db05, user_id=4b1b597d3dcd450db9e2691b38b37f77, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:00.723708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:00.739023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1377/2760] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:35:00 2022] PUT /identity/v3/projects/18ec6d2fa3a94ad6a161def80385db05/users/4b1b597d3dcd450db9e2691b38b37f77/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:35:00.743124 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:00.754358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e567d6-b7e3-4f57-ba8a-f29f606d5424 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:00.812986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162cc30-6938-453b-bbc5-b895dd693041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:00.813676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162cc30-6938-453b-bbc5-b895dd693041 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:00.813959 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162cc30-6938-453b-bbc5-b895dd693041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:00.814231 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162cc30-6938-453b-bbc5-b895dd693041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:00.815031 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162cc30-6938-453b-bbc5-b895dd693041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:00.816636 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162cc30-6938-453b-bbc5-b895dd693041 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:00.828627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1384/2761] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:35:00.832833 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:00.845225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dcb27-ae32-4ac1-9412-e52e594baf07 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:00.850210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fde737-9a7c-4e5e-9996-c9b57af98cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:00.851157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fde737-9a7c-4e5e-9996-c9b57af98cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:00.851443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fde737-9a7c-4e5e-9996-c9b57af98cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:00.851717 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fde737-9a7c-4e5e-9996-c9b57af98cc2 admin admin] PATH_INFO: `/v3/projects/18ec6d2fa3a94ad6a161def80385db05/users/4b1b597d3dcd450db9e2691b38b37f77/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:00.854181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fde737-9a7c-4e5e-9996-c9b57af98cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ec6d2fa3a94ad6a161def80385db05, user_id=4b1b597d3dcd450db9e2691b38b37f77, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:00.856890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fde737-9a7c-4e5e-9996-c9b57af98cc2 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:00.869071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1378/2762] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:35:00 2022] PUT /identity/v3/projects/18ec6d2fa3a94ad6a161def80385db05/users/4b1b597d3dcd450db9e2691b38b37f77/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:35:06.149009 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:06.150001 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:06.150545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:06.183760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] MFA Rules not processed for user `84331f5a01b74afa97dd200bbd4b4a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:35:06.185383 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:35:06.231390 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae02cb-670f-4c37-85c1-50c854b557c7 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:06.231854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae02cb-670f-4c37-85c1-50c854b557c7 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:06.231949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae02cb-670f-4c37-85c1-50c854b557c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:06.262515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-63ae02cb-670f-4c37-85c1-50c854b557c7 None None] MFA Rules not processed for user `4b1b597d3dcd450db9e2691b38b37f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:35:06.263753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-63ae02cb-670f-4c37-85c1-50c854b557c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:35:06.284232 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1385/2763] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:35:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:35:06.353402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1379/2764] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:35:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:35:06.373822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:06.375080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:35:06.390056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:06.528595 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a584a0-cae7-46a3-bcab-1afc17eeb30a None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:06.534611 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:06.535276 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:06.535561 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:06.535955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:06.615589 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:06.625174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:06.643390 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1386/2765] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:35:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:35:07.888841 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2871f-b175-4940-9066-778ee336c4e6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:07.889463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2871f-b175-4940-9066-778ee336c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:07.889463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2871f-b175-4940-9066-778ee336c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:07.919056 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f0f2871f-b175-4940-9066-778ee336c4e6 None None] MFA Rules not processed for user `45eff53f0e6c4ac499d163c36b43dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:35:07.920333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f0f2871f-b175-4940-9066-778ee336c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:35:07.934004 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1380/2766] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:35:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:35:16.635318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=70 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:17.902738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=56,keystone:INSERT=2 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:35:32.876235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:35:32.952540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97003f-0e6a-42f0-a565-cd30b3496c72 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:35:32.957064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:35:32.957720 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:35:32.958002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:35:32.958271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:35:32.968826 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:35:32.970274 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:35:32.980688 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1387/2767] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:35:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:35:42.975895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=30 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:08.675780 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8294c3e-1d57-43ae-8f88-7acca7fd5b45 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:36:08.676355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8294c3e-1d57-43ae-8f88-7acca7fd5b45 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:36:08.676355 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8294c3e-1d57-43ae-8f88-7acca7fd5b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:36:08.696861 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d8294c3e-1d57-43ae-8f88-7acca7fd5b45 None None] MFA Rules not processed for user `84331f5a01b74afa97dd200bbd4b4a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:36:08.698160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d8294c3e-1d57-43ae-8f88-7acca7fd5b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:36:08.706446 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1381/2768] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:36:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:36:15.706311 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:36:15.707937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:36:15.822468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005b353-5287-4ced-aaf4-165e7e849e67 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:36:15.828025 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:36:15.828680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:36:15.828964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:36:15.829241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:36:15.831356 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:36:15.844042 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:36:15.845626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:36:15.856430 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1388/2769] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:36:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:36:18.691502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:36:25.852133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=41 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:10.990948 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f15df-c182-4035-8ceb-8fc1b7ee93dc None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:37:10.991544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f15df-c182-4035-8ceb-8fc1b7ee93dc None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:37:10.991544 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f15df-c182-4035-8ceb-8fc1b7ee93dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:37:11.010140 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b55f15df-c182-4035-8ceb-8fc1b7ee93dc None None] MFA Rules not processed for user `84331f5a01b74afa97dd200bbd4b4a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:37:11.011590 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b55f15df-c182-4035-8ceb-8fc1b7ee93dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:37:11.020372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1382/2770] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:37:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:37:17.457095 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:37:17.458748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:37:17.494174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771926b-58ef-400f-9b9d-6c7742848df4 service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:37:17.498355 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:37:17.499396 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:37:17.499701 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:37:17.499977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:37:17.501804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:37:17.519581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:37:17.521054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:37:17.533334 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1389/2771] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:37:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:37:18.712301 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f15df-c182-4035-8ceb-8fc1b7ee93dc None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:37:18.724782 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f15df-c182-4035-8ceb-8fc1b7ee93dc None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:37:18.729563 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:37:18.730215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:37:18.730531 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:37:18.730835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:37:18.733095 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:37:18.747070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:37:18.748452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:37:18.760170 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1383/2772] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:37:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:37:27.527921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=11 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:28.755395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=9 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:45.331655 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:37:45.340551 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eafdff-8076-44e5-8421-c73e596fa888 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:37:45.345723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:37:45.346422 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:37:45.346721 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:37:45.351207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:37:45.353496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:37:45.365531 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:37:45.367022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:37:45.375818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1390/2773] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:37:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:37:45.449940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:37:45.458924 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b622b1-e00c-4fe6-8587-072a53104aa3 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:37:45.462848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:37:45.463491 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:37:45.463772 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:37:45.464042 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:37:45.465872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:37:45.480284 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:37:45.481740 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:37:45.493178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1384/2774] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:37:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:37:48.706173 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:37:48.718903 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b02aa8-6ba2-49b9-a1a2-0afdae787642 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:37:48.723525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:37:48.724199 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:37:48.724481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:37:48.724776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:37:48.727115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:37:48.737413 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:37:48.738895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:37:48.747303 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1391/2775] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:37:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:37:55.488139 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=6 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:37:58.743598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=12 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:06.607712 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:06.609316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:06.623160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca2ed4-3879-46c2-b468-925dea104d78 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:06.628710 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:06.629369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:06.629652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:06.629922 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:06.631752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:06.645180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:06.646823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:06.658233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1385/2776] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:14.985989 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:14.987841 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:15.087871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587f3d3-55fa-43b3-9f7a-66e988c341a2 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.093060 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.093943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.094223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.094522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] PATH_INFO: `/v3/users/84331f5a01b74afa97dd200bbd4b4a51` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.095759 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84331f5a01b74afa97dd200bbd4b4a51)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:15.097692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:15.151418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84331f5a01b74afa97dd200bbd4b4a51'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.159336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84331f5a01b74afa97dd200bbd4b4a51'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.171962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84331f5a01b74afa97dd200bbd4b4a51'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.179375 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84331f5a01b74afa97dd200bbd4b4a51'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.180091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f72091f8-69b4-4e02-bdca-390ff6c0b3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84331f5a01b74afa97dd200bbd4b4a51'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.186529 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1392/2777] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:14 2022] DELETE /identity/v3/users/84331f5a01b74afa97dd200bbd4b4a51 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:15.372459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:15.388410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9de52-d30b-4722-afd4-a25e853a8d75 service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.447881 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.448690 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.448969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.449240 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] PATH_INFO: `/v3/projects/e025435b30094ffea4dbd72bbafb9c3a` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.450604 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e025435b30094ffea4dbd72bbafb9c3a)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:15.452539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:15.501364 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e025435b30094ffea4dbd72bbafb9c3a', 'request_id': 'req-b1e18431-8af1-48f6-b6c6-5c858d774825'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.507010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e025435b30094ffea4dbd72bbafb9c3a', 'request_id': 'req-b1e18431-8af1-48f6-b6c6-5c858d774825'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.513082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e025435b30094ffea4dbd72bbafb9c3a', 'request_id': 'req-b1e18431-8af1-48f6-b6c6-5c858d774825'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.526311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] The token cache is being invalidate because project e025435b30094ffea4dbd72bbafb9c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:15.526609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.527232 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b1e18431-8af1-48f6-b6c6-5c858d774825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:15.528793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1386/2778] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:15 2022] DELETE /identity/v3/projects/e025435b30094ffea4dbd72bbafb9c3a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:15.533858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41ad88-eb95-4f11-a50e-9f414927af2c None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.534160 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41ad88-eb95-4f11-a50e-9f414927af2c None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.534537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41ad88-eb95-4f11-a50e-9f414927af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.595351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-9e41ad88-eb95-4f11-a50e-9f414927af2c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:15.596602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-9e41ad88-eb95-4f11-a50e-9f414927af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:15.610955 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:15.660594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1393/2779] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:15.669101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd23ed-ca52-4c3a-be5d-c971d18a46a4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.669382 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd23ed-ca52-4c3a-be5d-c971d18a46a4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.669653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd23ed-ca52-4c3a-be5d-c971d18a46a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.689053 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-2cbd23ed-ca52-4c3a-be5d-c971d18a46a4 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:15.690277 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-2cbd23ed-ca52-4c3a-be5d-c971d18a46a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:15.699423 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1387/2780] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:15.703889 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41ad88-eb95-4f11-a50e-9f414927af2c None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:15.713950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41ad88-eb95-4f11-a50e-9f414927af2c None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.718683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.719351 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.719648 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.719922 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.720680 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:15.720986 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:15.722633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:15.735191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1394/2781] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:15.739831 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd23ed-ca52-4c3a-be5d-c971d18a46a4 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:15.750407 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd23ed-ca52-4c3a-be5d-c971d18a46a4 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.755409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.756226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.756547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.756849 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.757557 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:15.759582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:15.798620 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1388/2782] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:15 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:38:15.803016 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:15.813152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26f820-e845-4980-9ede-e59f0c22bf5b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.872866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.873584 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.873861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.874139 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.874859 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:15.876892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:15.899307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1395/2783] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:15 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:15.903539 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:15.914705 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d469c-130e-4217-992c-f9100c14b743 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.920365 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.921032 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.921311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.921582 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.922325 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:15.923963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:15.934323 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1389/2784] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:15.938418 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:15.949329 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d4fbb-2a53-4652-b145-a11fb45f472a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.955100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570dd0-0383-4744-aee7-2215a8b503e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.955763 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570dd0-0383-4744-aee7-2215a8b503e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.956043 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570dd0-0383-4744-aee7-2215a8b503e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.956318 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570dd0-0383-4744-aee7-2215a8b503e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:15.957067 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570dd0-0383-4744-aee7-2215a8b503e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:15.958950 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570dd0-0383-4744-aee7-2215a8b503e8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:15.970917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1396/2785] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:15.975750 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:15.985991 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06c62-e9ac-4af9-95e4-ba9d4d1d0143 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:15.991068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:15.991945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:15.992229 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:15.992498 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] PATH_INFO: `/v3/projects/45540942fb1a4e00b2b8c4845909abb9/users/ce5f7d6610ff405796b757a1cfb12611/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:16.007532 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45540942fb1a4e00b2b8c4845909abb9, user_id=ce5f7d6610ff405796b757a1cfb12611, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:16.010203 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:16.025694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1390/2786] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:15 2022] PUT /identity/v3/projects/45540942fb1a4e00b2b8c4845909abb9/users/ce5f7d6610ff405796b757a1cfb12611/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:16.035879 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be2f92-d0a4-4933-ba1e-b012817ff153 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:16.036506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be2f92-d0a4-4933-ba1e-b012817ff153 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:16.036506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be2f92-d0a4-4933-ba1e-b012817ff153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:16.062088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-44be2f92-d0a4-4933-ba1e-b012817ff153 None None] MFA Rules not processed for user `ce5f7d6610ff405796b757a1cfb12611`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:16.063316 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-44be2f92-d0a4-4933-ba1e-b012817ff153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:16.138612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1397/2787] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:16.150520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:16.152394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:16.157507 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:16.234076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c21a4-8c75-4eb8-8376-411dea90b164 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:16.238039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36aea41-914c-4893-a960-42e95af99499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:16.238732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aea41-914c-4893-a960-42e95af99499 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:16.239010 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aea41-914c-4893-a960-42e95af99499 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:16.239285 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36aea41-914c-4893-a960-42e95af99499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:16.248579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aea41-914c-4893-a960-42e95af99499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:16.250020 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36aea41-914c-4893-a960-42e95af99499 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:16.259512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1391/2788] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:24.701949 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be2f92-d0a4-4933-ba1e-b012817ff153 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:24.721395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:24.772064 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be2f92-d0a4-4933-ba1e-b012817ff153 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:24.777092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:24.777974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:24.778243 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:24.778548 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] PATH_INFO: `/v3/users/ce5f7d6610ff405796b757a1cfb12611` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:24.779785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5f7d6610ff405796b757a1cfb12611)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:24.781719 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:24.838346 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5f7d6610ff405796b757a1cfb12611'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:24.847753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5f7d6610ff405796b757a1cfb12611'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:24.861533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5f7d6610ff405796b757a1cfb12611'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:24.868874 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5f7d6610ff405796b757a1cfb12611'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:24.869545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5f7d6610ff405796b757a1cfb12611'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:24.875953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1398/2789] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:24 2022] DELETE /identity/v3/users/ce5f7d6610ff405796b757a1cfb12611 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:24.880762 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:24.881256 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:24.881381 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:24.899453 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:24.900699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:24.962015 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1392/2790] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:38:24.977354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:24.978967 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:25.044633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a3699-a799-49f4-b40c-4afb31daad93 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.048957 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747d46c-5302-417f-a1e4-27ecf1a9ae4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.049614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747d46c-5302-417f-a1e4-27ecf1a9ae4b service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.049901 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747d46c-5302-417f-a1e4-27ecf1a9ae4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.050174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747d46c-5302-417f-a1e4-27ecf1a9ae4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.060434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747d46c-5302-417f-a1e4-27ecf1a9ae4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.061891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747d46c-5302-417f-a1e4-27ecf1a9ae4b service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.071662 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1399/2791] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:25.365306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:25.367060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:25.381708 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d012a-544b-4cfc-91e9-1cbf021cf923 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.386572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.387585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.387872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.388299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] PATH_INFO: `/v3/projects/45540942fb1a4e00b2b8c4845909abb9` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.393377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=45540942fb1a4e00b2b8c4845909abb9)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.395492 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.452806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45540942fb1a4e00b2b8c4845909abb9', 'request_id': 'req-16f7d5ba-ad94-4903-bf0c-270367d051ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:25.458545 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45540942fb1a4e00b2b8c4845909abb9', 'request_id': 'req-16f7d5ba-ad94-4903-bf0c-270367d051ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:25.465173 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45540942fb1a4e00b2b8c4845909abb9', 'request_id': 'req-16f7d5ba-ad94-4903-bf0c-270367d051ce'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:25.479897 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] The token cache is being invalidate because project 45540942fb1a4e00b2b8c4845909abb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:25.480204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:25.480796 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-16f7d5ba-ad94-4903-bf0c-270367d051ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:25.482731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1393/2792] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:25 2022] DELETE /identity/v3/projects/45540942fb1a4e00b2b8c4845909abb9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:25.487952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfede7-844e-4bc4-87ff-f6fc81fef1e7 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.488252 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfede7-844e-4bc4-87ff-f6fc81fef1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.488559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfede7-844e-4bc4-87ff-f6fc81fef1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.507639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-97bfede7-844e-4bc4-87ff-f6fc81fef1e7 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:25.508848 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-97bfede7-844e-4bc4-87ff-f6fc81fef1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:25.542106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:25.574594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1400/2793] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:25.583030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e9b1-4cfb-4629-b696-2f2c2a3b929c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.583322 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e9b1-4cfb-4629-b696-2f2c2a3b929c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.583623 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9e9b1-4cfb-4629-b696-2f2c2a3b929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.604314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fbe9e9b1-4cfb-4629-b696-2f2c2a3b929c None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:25.605597 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fbe9e9b1-4cfb-4629-b696-2f2c2a3b929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:25.615166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1394/2794] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:25.619785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfede7-844e-4bc4-87ff-f6fc81fef1e7 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:25.631403 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfede7-844e-4bc4-87ff-f6fc81fef1e7 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.636670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.637335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.637617 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.637900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.638934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:25.639262 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.640908 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.652821 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1401/2795] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:25.657603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9e9b1-4cfb-4629-b696-2f2c2a3b929c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:25.663550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:25.668510 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9e9b1-4cfb-4629-b696-2f2c2a3b929c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.675167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.675847 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.676332 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.676877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.681837 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.683803 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.720818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1395/2796] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:25 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:25.721913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:25.736335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25b2fc-d99e-4c66-b9dd-fc29ec0d287f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.800856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.801540 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.801824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.802094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.802824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.804727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.825866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1402/2797] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:25 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:25.830079 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:25.840554 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680fef-0255-430f-885e-15d220881d9a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.845482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.846147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.846460 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.846738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.847475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.849085 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.860653 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1396/2798] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:25.864745 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:25.875037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e1d3-efd7-4d45-95ad-457025df7aeb admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.879871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd28ffa-a0e3-4977-9635-f42cef4a7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.880536 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28ffa-a0e3-4977-9635-f42cef4a7e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.880817 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28ffa-a0e3-4977-9635-f42cef4a7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.881088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd28ffa-a0e3-4977-9635-f42cef4a7e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.881833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28ffa-a0e3-4977-9635-f42cef4a7e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.883465 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd28ffa-a0e3-4977-9635-f42cef4a7e78 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.893682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1403/2799] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:25.899614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:25.910206 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbe436-a71c-426f-b3b3-2c7b51947df3 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:25.915251 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:25.916137 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.916418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.916693 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] PATH_INFO: `/v3/projects/a6059459192b49d7ad252f00d1ddea98/users/a04b37dbb53b44209d2234a4c4beec92/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.931797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6059459192b49d7ad252f00d1ddea98, user_id=a04b37dbb53b44209d2234a4c4beec92, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:25.934584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:25.949502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1397/2800] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:25 2022] PUT /identity/v3/projects/a6059459192b49d7ad252f00d1ddea98/users/a04b37dbb53b44209d2234a4c4beec92/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:25.960003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11bb9f-f123-4ab6-b792-06a9bf794c13 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:25.960387 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11bb9f-f123-4ab6-b792-06a9bf794c13 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:25.960772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11bb9f-f123-4ab6-b792-06a9bf794c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:25.989644 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-fa11bb9f-f123-4ab6-b792-06a9bf794c13 None None] MFA Rules not processed for user `a04b37dbb53b44209d2234a4c4beec92`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:25.990892 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa11bb9f-f123-4ab6-b792-06a9bf794c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:26.066888 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1404/2801] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:38:26.073475 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:26.148751 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d216269-1440-405e-8f26-5bdeed15fc5d admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:26.154103 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:26.154779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.155087 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.155344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.156031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:26.157995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:26.188547 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1398/2802] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:26 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:26.192921 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11bb9f-f123-4ab6-b792-06a9bf794c13 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:26.205397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11bb9f-f123-4ab6-b792-06a9bf794c13 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:26.236550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:26.263760 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:26.264314 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.264592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.264858 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.265533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:26.267473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:26.288661 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1405/2803] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:26 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:26.292801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:26.304678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ffbea-3480-4c19-ae85-cab51aa77777 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:26.309342 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:26.310013 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.310396 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.310679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.311412 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:26.313120 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:26.324769 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1399/2804] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:26.329496 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:26.340158 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa522e-7fb7-43ba-a407-eeefd5c06674 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:26.346272 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:26.347201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.347484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.347774 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] PATH_INFO: `/v3/projects/88c27ef535604a1b844ff73324dabfb0/users/841a7ee033d9402b8953091e03db007d/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.363850 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c27ef535604a1b844ff73324dabfb0, user_id=841a7ee033d9402b8953091e03db007d, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:26.366566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:26.382221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1406/2805] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:26 2022] PUT /identity/v3/projects/88c27ef535604a1b844ff73324dabfb0/users/841a7ee033d9402b8953091e03db007d/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:26.386426 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:26.396916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127248d2-46b0-47e6-9e2d-b32ed5f3131e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:26.452664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfa7e8-b0b1-49bc-a9c9-6931bdd27eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:26.453316 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfa7e8-b0b1-49bc-a9c9-6931bdd27eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.453599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfa7e8-b0b1-49bc-a9c9-6931bdd27eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.453876 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfa7e8-b0b1-49bc-a9c9-6931bdd27eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.454663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfa7e8-b0b1-49bc-a9c9-6931bdd27eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:26.456269 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfa7e8-b0b1-49bc-a9c9-6931bdd27eb0 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:26.466083 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1400/2806] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:26.470914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:26.482520 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7634c33-55ba-472c-9f80-0f3220f8d124 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:26.487928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:26.488819 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.489090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.489354 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] PATH_INFO: `/v3/projects/88c27ef535604a1b844ff73324dabfb0/users/841a7ee033d9402b8953091e03db007d/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.491781 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c27ef535604a1b844ff73324dabfb0, user_id=841a7ee033d9402b8953091e03db007d, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:26.494749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:26.505775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1407/2807] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:26 2022] PUT /identity/v3/projects/88c27ef535604a1b844ff73324dabfb0/users/841a7ee033d9402b8953091e03db007d/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:26.516444 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0293-30e3-4e70-9681-0e09e397d04c None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.516626 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0293-30e3-4e70-9681-0e09e397d04c None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.516927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0293-30e3-4e70-9681-0e09e397d04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.543877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-947d0293-30e3-4e70-9681-0e09e397d04c None None] MFA Rules not processed for user `841a7ee033d9402b8953091e03db007d`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:26.545351 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-947d0293-30e3-4e70-9681-0e09e397d04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:26.550836 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:26.621026 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1401/2808] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:26.632951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:26.634998 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:26.695576 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b9ea6-93e5-4f44-a29b-46e4e7edb516 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:26.700456 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2efd3-c41c-4207-bd83-91550b928c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:26.701294 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2efd3-c41c-4207-bd83-91550b928c5a service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:26.701776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2efd3-c41c-4207-bd83-91550b928c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:26.702063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2efd3-c41c-4207-bd83-91550b928c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:26.712137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2efd3-c41c-4207-bd83-91550b928c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:26.713620 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2efd3-c41c-4207-bd83-91550b928c5a service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:26.723630 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1408/2809] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:27.160699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0293-30e3-4e70-9681-0e09e397d04c None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:27.228063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0293-30e3-4e70-9681-0e09e397d04c None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:27.233109 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:27.234007 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:27.234314 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:27.234599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] PATH_INFO: `/v3/users/a04b37dbb53b44209d2234a4c4beec92` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:27.235871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04b37dbb53b44209d2234a4c4beec92)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:27.237823 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:27.287034 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04b37dbb53b44209d2234a4c4beec92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.287614 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04b37dbb53b44209d2234a4c4beec92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.288222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04b37dbb53b44209d2234a4c4beec92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.295402 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04b37dbb53b44209d2234a4c4beec92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.308352 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04b37dbb53b44209d2234a4c4beec92'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.323160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1402/2810] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:27 2022] DELETE /identity/v3/users/a04b37dbb53b44209d2234a4c4beec92 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:27.327882 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:27.328177 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:27.328457 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:27.346402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:27.347623 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:27.412744 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1409/2811] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:27.423566 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:27.427286 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:27.453592 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:27.502046 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf95b0-75b5-4c17-b401-441b7ca5eaf9 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:27.506218 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:27.506911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:27.507190 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:27.507482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:27.517408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:27.518915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:27.528834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1403/2812] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:27.823168 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:27.824748 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:27.839592 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a1057-a8da-49a7-9a93-ed03c83ec4fd None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:27.844947 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:27.845917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:27.846246 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:27.846612 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] PATH_INFO: `/v3/projects/a6059459192b49d7ad252f00d1ddea98` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:27.847962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6059459192b49d7ad252f00d1ddea98)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:27.849909 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:27.875184 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:27.899078 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6059459192b49d7ad252f00d1ddea98', 'request_id': 'req-dfae1967-a1bc-476b-bcaa-b7190628f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.907689 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6059459192b49d7ad252f00d1ddea98', 'request_id': 'req-dfae1967-a1bc-476b-bcaa-b7190628f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.914140 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6059459192b49d7ad252f00d1ddea98', 'request_id': 'req-dfae1967-a1bc-476b-bcaa-b7190628f36e'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.925445 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] The token cache is being invalidate because project a6059459192b49d7ad252f00d1ddea98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:27.925727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.926395 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:27.927912 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1410/2813] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:27 2022] DELETE /identity/v3/projects/a6059459192b49d7ad252f00d1ddea98 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:27.932076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:27.942250 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb7d4f-9ae3-47b3-93ba-16a584099238 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.005006 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.005902 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.006179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.006480 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] PATH_INFO: `/v3/users/841a7ee033d9402b8953091e03db007d` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.007741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841a7ee033d9402b8953091e03db007d)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.009716 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:28.067238 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841a7ee033d9402b8953091e03db007d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.067915 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841a7ee033d9402b8953091e03db007d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.068627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841a7ee033d9402b8953091e03db007d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.076244 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841a7ee033d9402b8953091e03db007d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.089169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-f56b7abf-4575-4a0e-b746-bbd24404e369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841a7ee033d9402b8953091e03db007d'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.103479 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1404/2814] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:27 2022] DELETE /identity/v3/users/841a7ee033d9402b8953091e03db007d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:28.384434 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:28.385896 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:28.400237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae1967-a1bc-476b-bcaa-b7190628f36e admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.460331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.461214 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.461498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.461772 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] PATH_INFO: `/v3/projects/88c27ef535604a1b844ff73324dabfb0` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.463107 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c27ef535604a1b844ff73324dabfb0)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.465053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:28.528970 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c27ef535604a1b844ff73324dabfb0', 'request_id': 'req-ba5886bf-fff5-452e-bc35-d184ecbe3f06'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.537783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c27ef535604a1b844ff73324dabfb0', 'request_id': 'req-ba5886bf-fff5-452e-bc35-d184ecbe3f06'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.543776 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c27ef535604a1b844ff73324dabfb0', 'request_id': 'req-ba5886bf-fff5-452e-bc35-d184ecbe3f06'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.555554 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] The token cache is being invalidate because project 88c27ef535604a1b844ff73324dabfb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:28.555845 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.556550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-ba5886bf-fff5-452e-bc35-d184ecbe3f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:28.558204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1411/2815] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:28 2022] DELETE /identity/v3/projects/88c27ef535604a1b844ff73324dabfb0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:28.563468 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ad2a1-637f-4631-8669-fea9df1237c5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.563961 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ad2a1-637f-4631-8669-fea9df1237c5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.564062 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ad2a1-637f-4631-8669-fea9df1237c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.583333 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-242ad2a1-637f-4631-8669-fea9df1237c5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:28.584464 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-242ad2a1-637f-4631-8669-fea9df1237c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:28.627732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:28.648697 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1405/2816] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:28.658227 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09f77d-fc20-43a2-a8ab-f42f774140aa None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.658569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09f77d-fc20-43a2-a8ab-f42f774140aa None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.658842 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09f77d-fc20-43a2-a8ab-f42f774140aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.677234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ab09f77d-fc20-43a2-a8ab-f42f774140aa None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:28.678473 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ab09f77d-fc20-43a2-a8ab-f42f774140aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:28.686646 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1412/2817] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:28.691181 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ad2a1-637f-4631-8669-fea9df1237c5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:28.701210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ad2a1-637f-4631-8669-fea9df1237c5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.706984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.707635 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.707925 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.708188 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.708916 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:28.709219 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.710848 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:28.722683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1406/2818] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:28.727337 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09f77d-fc20-43a2-a8ab-f42f774140aa None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:28.737101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09f77d-fc20-43a2-a8ab-f42f774140aa None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.742911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.743572 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.743851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.744126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.744818 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.746771 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:28.775053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1413/2819] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:28 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:28.779226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:28.789493 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3fa79-74dc-450a-a06f-0840ad91df76 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.860818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.861397 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.861686 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.861939 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.862663 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.864599 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:28.887258 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1407/2820] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:28 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:28.891627 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:28.902913 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3155bb-ab9c-4bfb-8381-61a193f90d4c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.908219 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.908895 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.909164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.909437 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.910165 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.911851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:28.923266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1414/2821] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:28.927908 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:28.938812 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88237a8-5c72-4666-9c43-90c27b55936a admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.944076 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d683c99-64cf-4a5c-9ab2-7cf2b604b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.944773 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683c99-64cf-4a5c-9ab2-7cf2b604b4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.945055 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683c99-64cf-4a5c-9ab2-7cf2b604b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.945330 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683c99-64cf-4a5c-9ab2-7cf2b604b4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.946061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d683c99-64cf-4a5c-9ab2-7cf2b604b4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.947728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d683c99-64cf-4a5c-9ab2-7cf2b604b4e5 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:28.957942 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1408/2822] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:28.961963 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:28.967522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:28.974137 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc700a08-a26c-4ff9-8c07-831686d032ef admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:28.980610 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:28.981498 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:28.981780 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:28.982054 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] PATH_INFO: `/v3/projects/d62c7ccae2ea4450bed201f3eec6dbb3/users/194b6beaeeb14d568b6e6a958efc6007/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:28.996577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62c7ccae2ea4450bed201f3eec6dbb3, user_id=194b6beaeeb14d568b6e6a958efc6007, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:28.999376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.012866 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1415/2823] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:28 2022] PUT /identity/v3/projects/d62c7ccae2ea4450bed201f3eec6dbb3/users/194b6beaeeb14d568b6e6a958efc6007/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:29.023300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe44e-5954-466d-87ad-a2da48bd08d6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.023585 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe44e-5954-466d-87ad-a2da48bd08d6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.023894 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe44e-5954-466d-87ad-a2da48bd08d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.051724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-03afe44e-5954-466d-87ad-a2da48bd08d6 None None] MFA Rules not processed for user `194b6beaeeb14d568b6e6a958efc6007`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:29.052940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-03afe44e-5954-466d-87ad-a2da48bd08d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:29.122401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1409/2824] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:29.127089 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:29.192279 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430559dc-8464-42f4-91a8-842a0e5c1240 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:29.197563 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:29.198229 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.198544 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.198822 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.199480 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:29.201557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.235304 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1416/2825] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:29 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:29.240027 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe44e-5954-466d-87ad-a2da48bd08d6 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:29.257082 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe44e-5954-466d-87ad-a2da48bd08d6 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:29.306448 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:29.325901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:29.326628 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.326906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.327176 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.327934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:29.329855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.350982 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1410/2826] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:29 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:29.355188 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:29.366307 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b9129-2db7-4e85-9744-8415eb355b0f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:29.371779 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:29.372534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.372761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.373039 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.374100 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:29.375785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.387126 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1417/2827] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:29.391418 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:29.401975 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb85c8-4ee7-44ff-b180-98c5891c5913 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:29.407775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:29.408668 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.408928 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.409222 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] PATH_INFO: `/v3/projects/63385ac6f435400481c57ce7e905b1af/users/1951b6edf6fd41da9f19e95d9408ed78/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.426348 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63385ac6f435400481c57ce7e905b1af, user_id=1951b6edf6fd41da9f19e95d9408ed78, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:29.429099 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.443607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1411/2828] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:29 2022] PUT /identity/v3/projects/63385ac6f435400481c57ce7e905b1af/users/1951b6edf6fd41da9f19e95d9408ed78/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:38:29.447668 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:29.457985 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb5589-5b9a-4c6a-b478-f5f88922948a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:29.520992 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af901d-fdbe-4e28-b075-15688fec5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:29.521926 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af901d-fdbe-4e28-b075-15688fec5992 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.522350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af901d-fdbe-4e28-b075-15688fec5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.522716 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af901d-fdbe-4e28-b075-15688fec5992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.523831 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af901d-fdbe-4e28-b075-15688fec5992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:29.526410 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af901d-fdbe-4e28-b075-15688fec5992 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.537775 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1418/2829] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:29.542167 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:29.552700 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2b4d8-de85-4dc4-b952-38dc215bff82 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:29.557731 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:29.558651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.558934 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.559204 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] PATH_INFO: `/v3/projects/63385ac6f435400481c57ce7e905b1af/users/1951b6edf6fd41da9f19e95d9408ed78/roles/9cb432924fc7410bbed794ed0a33b85c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.561343 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63385ac6f435400481c57ce7e905b1af, user_id=1951b6edf6fd41da9f19e95d9408ed78, role_id=9cb432924fc7410bbed794ed0a33b85c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:29.564030 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.574990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1412/2830] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:29 2022] PUT /identity/v3/projects/63385ac6f435400481c57ce7e905b1af/users/1951b6edf6fd41da9f19e95d9408ed78/roles/9cb432924fc7410bbed794ed0a33b85c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:29.586756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6b01-33ba-4684-97ad-e42eb00e4ed3 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.587045 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6b01-33ba-4684-97ad-e42eb00e4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.587319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e6b01-33ba-4684-97ad-e42eb00e4ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.616357 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-b26e6b01-33ba-4684-97ad-e42eb00e4ed3 None None] MFA Rules not processed for user `1951b6edf6fd41da9f19e95d9408ed78`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:29.617565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b26e6b01-33ba-4684-97ad-e42eb00e4ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:29.792011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:29.826149 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1419/2831] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:29.839572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:29.842526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:29.915603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2a8b-5a5a-4b24-aa1b-1a43b4882f1b admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:29.919728 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:29.920573 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:29.920906 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:29.921119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:29.930735 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:29.932179 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:29.941923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1413/2832] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:30.302614 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e6b01-33ba-4684-97ad-e42eb00e4ed3 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:30.312891 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e6b01-33ba-4684-97ad-e42eb00e4ed3 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:30.318650 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1951b6edf6fd41da9f19e95d9408ed78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63385ac6f435400481c57ce7e905b1af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:30.319336 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:30.319626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:30.319911 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:30.320670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:30.321012 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:30.322666 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:30.335164 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1420/2833] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:30.339980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:30.350933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4fb2c-dee2-4d92-804b-68484b690991 service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:30.355969 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1951b6edf6fd41da9f19e95d9408ed78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63385ac6f435400481c57ce7e905b1af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:30.356627 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:30.356913 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:30.357189 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:30.357899 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:30.359976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:30.392752 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1414/2834] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:30 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:30.396914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:30.407782 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75acb-7671-45f1-971d-783af845f7b0 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:30.466943 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1951b6edf6fd41da9f19e95d9408ed78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63385ac6f435400481c57ce7e905b1af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:30.467677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:30.468497 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:30.468785 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:30.469545 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:30.469844 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:30.471514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:30.484622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1421/2835] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:30.524799 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:30.538664 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3414e-1c66-4e79-8094-ef6beda110de tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:30.544357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1951b6edf6fd41da9f19e95d9408ed78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63385ac6f435400481c57ce7e905b1af', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:30.545239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:30.545524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:30.546069 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] PATH_INFO: `/v3/projects/7beb98e49c7c4480a52c8ca97bdf1b17` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:30.547719 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7beb98e49c7c4480a52c8ca97bdf1b17)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:30.549645 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:30.606130 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7beb98e49c7c4480a52c8ca97bdf1b17', 'request_id': 'req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:30.612451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7beb98e49c7c4480a52c8ca97bdf1b17', 'request_id': 'req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:30.619472 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7beb98e49c7c4480a52c8ca97bdf1b17', 'request_id': 'req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:30.623372 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:30.635637 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] The token cache is being invalidate because project 7beb98e49c7c4480a52c8ca97bdf1b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:30.635872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:30.636621 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-3f6968c2-8bf0-43ed-b9a9-1229cdc80420 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:30.638225 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1415/2836] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:30 2022] DELETE /identity/v3/projects/7beb98e49c7c4480a52c8ca97bdf1b17 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:30.858622 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:30.860633 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:30.928405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebadb5-fecc-4a26-9354-e889961a8876 tempest-VolumeQuotaClassesTest-1492823938 tempest-VolumeQuotaClassesTest-1492823938-project-admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:30.985606 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:30.986526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:30.986804 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:30.987076 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] PATH_INFO: `/v3/users/194b6beaeeb14d568b6e6a958efc6007` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:30.988381 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194b6beaeeb14d568b6e6a958efc6007)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:30.990394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:30.992750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=100 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:31.040267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194b6beaeeb14d568b6e6a958efc6007'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.050853 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194b6beaeeb14d568b6e6a958efc6007'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.063481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194b6beaeeb14d568b6e6a958efc6007'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.070867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194b6beaeeb14d568b6e6a958efc6007'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.071574 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194b6beaeeb14d568b6e6a958efc6007'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.078189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1422/2837] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:30 2022] DELETE /identity/v3/users/194b6beaeeb14d568b6e6a958efc6007 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:31.083354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:31.083711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:31.083990 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:31.103363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:31.104572 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:31.173602 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1416/2838] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:31.183433 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:31.185023 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:31.245343 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d171c-ec88-44d6-b5d7-0be9d34dd2d8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:31.249693 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:31.250341 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:31.250703 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:31.250975 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:31.261129 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:31.262586 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:31.272717 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1423/2839] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:31.569157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:31.570742 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:31.585228 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7db2df-7cda-427b-a6d4-1dbf23427f75 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:31.590927 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:31.591929 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:31.592267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:31.592605 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] PATH_INFO: `/v3/projects/d62c7ccae2ea4450bed201f3eec6dbb3` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:31.597252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62c7ccae2ea4450bed201f3eec6dbb3)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:31.597252 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:31.651920 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62c7ccae2ea4450bed201f3eec6dbb3', 'request_id': 'req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.658369 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62c7ccae2ea4450bed201f3eec6dbb3', 'request_id': 'req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.665353 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62c7ccae2ea4450bed201f3eec6dbb3', 'request_id': 'req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.680050 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] The token cache is being invalidate because project d62c7ccae2ea4450bed201f3eec6dbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:31.680362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.681031 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.682678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1417/2840] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:31 2022] DELETE /identity/v3/projects/d62c7ccae2ea4450bed201f3eec6dbb3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:31.686962 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:31.696828 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709213c8-2539-4cc3-a44f-8cada75dd9a0 service neutron] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:31.755988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:31.756902 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:31.757189 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:31.757503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] PATH_INFO: `/v3/users/1951b6edf6fd41da9f19e95d9408ed78` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:31.758750 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1951b6edf6fd41da9f19e95d9408ed78)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:31.760690 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:31.789791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:31.815282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1951b6edf6fd41da9f19e95d9408ed78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.824090 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1951b6edf6fd41da9f19e95d9408ed78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.838377 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1951b6edf6fd41da9f19e95d9408ed78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.845358 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1951b6edf6fd41da9f19e95d9408ed78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.846004 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-f9c83e9c-f967-43e3-b607-ddf912cf7a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1951b6edf6fd41da9f19e95d9408ed78'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:31.852370 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1424/2841] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:31 2022] DELETE /identity/v3/users/1951b6edf6fd41da9f19e95d9408ed78 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:32.138463 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.140214 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:32.153588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65e9b8-3c08-4fef-9d5e-b2804a639a57 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.211714 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.212502 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.212781 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.213049 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] PATH_INFO: `/v3/projects/63385ac6f435400481c57ce7e905b1af` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.214259 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63385ac6f435400481c57ce7e905b1af)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:32.216207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:32.239068 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:32.263890 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63385ac6f435400481c57ce7e905b1af', 'request_id': 'req-484eb241-f9eb-433c-adde-b4c8e80446b8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:32.269724 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63385ac6f435400481c57ce7e905b1af', 'request_id': 'req-484eb241-f9eb-433c-adde-b4c8e80446b8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:32.276186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63385ac6f435400481c57ce7e905b1af', 'request_id': 'req-484eb241-f9eb-433c-adde-b4c8e80446b8'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:32.291366 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] The token cache is being invalidate because project 63385ac6f435400481c57ce7e905b1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:32.291655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:32.292356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-484eb241-f9eb-433c-adde-b4c8e80446b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:32.293952 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1418/2842] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:32 2022] DELETE /identity/v3/projects/63385ac6f435400481c57ce7e905b1af => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:32.299080 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6234376-4990-45e1-b71e-e124f6f3a8b1 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.299365 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6234376-4990-45e1-b71e-e124f6f3a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.299639 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6234376-4990-45e1-b71e-e124f6f3a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.317735 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d6234376-4990-45e1-b71e-e124f6f3a8b1 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:32.318958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d6234376-4990-45e1-b71e-e124f6f3a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:32.381709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1425/2843] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:32.447701 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0ca2-ce12-4faf-8100-5b864ce32f8d None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.447980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0ca2-ce12-4faf-8100-5b864ce32f8d None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.448390 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0ca2-ce12-4faf-8100-5b864ce32f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.471339 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c13d0ca2-ce12-4faf-8100-5b864ce32f8d None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:32.472473 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c13d0ca2-ce12-4faf-8100-5b864ce32f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:32.482644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1419/2844] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:32.487248 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6234376-4990-45e1-b71e-e124f6f3a8b1 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.497417 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6234376-4990-45e1-b71e-e124f6f3a8b1 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.503074 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.503727 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.504005 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.504251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.504979 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:32.505281 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:32.506928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:32.522466 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1426/2845] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:32.526965 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0ca2-ce12-4faf-8100-5b864ce32f8d None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.536679 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0ca2-ce12-4faf-8100-5b864ce32f8d None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.542753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.543400 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.543678 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.543938 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.544612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:32.546551 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:32.576526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1420/2846] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:32 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:32.581022 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.591302 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368afdb-a2ee-44c8-8283-0a9cd0ce604b admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.652506 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.653467 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.653743 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.654038 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.655133 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:32.657761 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:32.679460 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1427/2847] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:32 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:32.683855 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.694371 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5cdc3-a326-4942-a45c-1da5d35d0a63 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.699210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.699866 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.700144 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.700415 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.701152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:32.702802 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:32.714073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1421/2848] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:32.718109 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.729255 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce789a-d467-4b62-b0a3-393fd611e2a8 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.734756 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a884cf7-8c17-49dc-8d1a-af4dbc282575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.735421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884cf7-8c17-49dc-8d1a-af4dbc282575 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.735856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884cf7-8c17-49dc-8d1a-af4dbc282575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.736132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a884cf7-8c17-49dc-8d1a-af4dbc282575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.736867 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884cf7-8c17-49dc-8d1a-af4dbc282575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:32.738499 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a884cf7-8c17-49dc-8d1a-af4dbc282575 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:32.748856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1428/2849] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:32.753197 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.763226 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba5803-4945-4b68-bac6-bb5bba308c6e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.768436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.769299 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.769579 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.769844 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] PATH_INFO: `/v3/projects/8b31c083abb04e388f9090e117140d98/users/ec99e82e352e460a8b13967f75eab346/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.784413 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b31c083abb04e388f9090e117140d98, user_id=ec99e82e352e460a8b13967f75eab346, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:32.787104 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:32.802985 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1422/2850] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:32 2022] PUT /identity/v3/projects/8b31c083abb04e388f9090e117140d98/users/ec99e82e352e460a8b13967f75eab346/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 17:38:32.814106 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d863b-4849-4e56-b3eb-ff6b46ce47eb None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.814515 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d863b-4849-4e56-b3eb-ff6b46ce47eb None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.814795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d863b-4849-4e56-b3eb-ff6b46ce47eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:32.833969 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:32.844535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-e09d863b-4849-4e56-b3eb-ff6b46ce47eb None None] MFA Rules not processed for user `ec99e82e352e460a8b13967f75eab346`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:32.846105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e09d863b-4849-4e56-b3eb-ff6b46ce47eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:32.915169 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1429/2851] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:32.926775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:32.928875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:32.989344 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd046d7-f938-4c4d-b874-a4345ad0fa8e admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:32.993270 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bee12-f126-4de6-8c25-958861fa755e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:32.993917 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bee12-f126-4de6-8c25-958861fa755e service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:32.994193 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bee12-f126-4de6-8c25-958861fa755e service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:32.994499 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bee12-f126-4de6-8c25-958861fa755e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.003515 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bee12-f126-4de6-8c25-958861fa755e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:33.005054 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bee12-f126-4de6-8c25-958861fa755e service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:33.014338 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1423/2852] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:33.035594 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d863b-4849-4e56-b3eb-ff6b46ce47eb None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:33.097856 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d863b-4849-4e56-b3eb-ff6b46ce47eb None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:33.103271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:33.104141 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:33.104416 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:33.104682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] PATH_INFO: `/v3/users/ec99e82e352e460a8b13967f75eab346` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.105916 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec99e82e352e460a8b13967f75eab346)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:33.107871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:33.158476 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec99e82e352e460a8b13967f75eab346'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.167977 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec99e82e352e460a8b13967f75eab346'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.181384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec99e82e352e460a8b13967f75eab346'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.189002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec99e82e352e460a8b13967f75eab346'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.189769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec99e82e352e460a8b13967f75eab346'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.196116 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1430/2853] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:33 2022] DELETE /identity/v3/users/ec99e82e352e460a8b13967f75eab346 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:33.200797 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:33.201224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:33.201501 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.219632 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:33.220835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:33.267454 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:33.293875 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1424/2854] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:33.306138 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:33.308557 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:33.331722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:33.383851 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea5738-5e38-4d0e-a711-ae91af1b2bff admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:33.387997 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae344545-a02d-49af-ba29-206dfa3fe342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:33.388654 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae344545-a02d-49af-ba29-206dfa3fe342 service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:33.388937 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae344545-a02d-49af-ba29-206dfa3fe342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:33.389209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae344545-a02d-49af-ba29-206dfa3fe342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.399682 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae344545-a02d-49af-ba29-206dfa3fe342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:33.401105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae344545-a02d-49af-ba29-206dfa3fe342 service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:33.411442 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1431/2855] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:33.711098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:33.712630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:33.729458 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c588e1-24ed-4fc7-85d1-8dd0486b0ede None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:33.735549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:33.736462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:33.736775 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:33.736976 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] PATH_INFO: `/v3/projects/8b31c083abb04e388f9090e117140d98` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.738235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b31c083abb04e388f9090e117140d98)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:33.740183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:33.788955 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b31c083abb04e388f9090e117140d98', 'request_id': 'req-122d36ce-02ec-4fc5-869e-a0b5219aa537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.794647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b31c083abb04e388f9090e117140d98', 'request_id': 'req-122d36ce-02ec-4fc5-869e-a0b5219aa537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.801060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b31c083abb04e388f9090e117140d98', 'request_id': 'req-122d36ce-02ec-4fc5-869e-a0b5219aa537'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.814921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] The token cache is being invalidate because project 8b31c083abb04e388f9090e117140d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:33.815205 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.815880 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-122d36ce-02ec-4fc5-869e-a0b5219aa537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:33.817436 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1425/2856] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:33 2022] DELETE /identity/v3/projects/8b31c083abb04e388f9090e117140d98 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:33.822591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea453d9c-ebec-45ac-b820-6c83c49da0ab None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:33.823091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea453d9c-ebec-45ac-b820-6c83c49da0ab None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:33.823207 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea453d9c-ebec-45ac-b820-6c83c49da0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.841991 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-ea453d9c-ebec-45ac-b820-6c83c49da0ab None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:33.843218 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-ea453d9c-ebec-45ac-b820-6c83c49da0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:33.905091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1432/2857] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:33.913159 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09a9c1-715c-4842-b122-19285fcf3022 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:33.913450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09a9c1-715c-4842-b122-19285fcf3022 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:33.913732 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09a9c1-715c-4842-b122-19285fcf3022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.933080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-fc09a9c1-715c-4842-b122-19285fcf3022 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:33.934318 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-fc09a9c1-715c-4842-b122-19285fcf3022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:33.943655 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1426/2858] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:33.949678 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea453d9c-ebec-45ac-b820-6c83c49da0ab None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:33.965204 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea453d9c-ebec-45ac-b820-6c83c49da0ab None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:33.973250 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:33.974174 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:33.974553 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:33.974823 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:33.976194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:33.976559 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:33.979053 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:33.998256 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1433/2859] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:34.002953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09a9c1-715c-4842-b122-19285fcf3022 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:34.013048 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09a9c1-715c-4842-b122-19285fcf3022 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:34.019711 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:34.020370 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:34.020648 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:34.020921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:34.021609 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:34.023540 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:34.052684 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1427/2860] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:34 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:34.058230 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:34.068535 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d635fbd-5f5e-48e5-989f-5295a96c4bac admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:34.133056 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:34.133728 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:34.134008 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:34.134338 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:34.135014 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:34.136934 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:34.160278 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1434/2861] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:34 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:38:34.166835 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:34.180186 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de886-2aff-4579-836c-b82878043dee admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:34.185877 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:34.186567 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:34.186843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:34.187117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:34.187834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:34.189511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:34.200023 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1428/2862] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:34.204581 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:34.214769 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d82d-0847-44e6-870b-25a77fed2980 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:34.220372 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b8aaa-d1d8-405f-82ca-418d1eb57029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:34.221044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b8aaa-d1d8-405f-82ca-418d1eb57029 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:34.221317 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b8aaa-d1d8-405f-82ca-418d1eb57029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:34.221591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b8aaa-d1d8-405f-82ca-418d1eb57029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:34.222447 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b8aaa-d1d8-405f-82ca-418d1eb57029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:34.224055 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b8aaa-d1d8-405f-82ca-418d1eb57029 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:34.234541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1435/2863] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:34.239274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:34.249618 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75082b38-63ea-4b01-a612-ed0cb89215c4 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:34.255039 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:34.255923 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:34.256208 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:34.256483 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] PATH_INFO: `/v3/projects/aa5e44b8512d4352ab8014529dfad543/users/c0240ec88e4148ea9a688b13afb1a755/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:34.274221 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa5e44b8512d4352ab8014529dfad543, user_id=c0240ec88e4148ea9a688b13afb1a755, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:34.276964 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:34.292465 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1429/2864] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:34 2022] PUT /identity/v3/projects/aa5e44b8512d4352ab8014529dfad543/users/c0240ec88e4148ea9a688b13afb1a755/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:34.304234 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84081-cf7d-4fe3-9146-c8ba3ce03480 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:34.304521 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84081-cf7d-4fe3-9146-c8ba3ce03480 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:34.304791 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d84081-cf7d-4fe3-9146-c8ba3ce03480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:34.333121 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-35d84081-cf7d-4fe3-9146-c8ba3ce03480 None None] MFA Rules not processed for user `c0240ec88e4148ea9a688b13afb1a755`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:34.334245 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-35d84081-cf7d-4fe3-9146-c8ba3ce03480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:34.348726 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:34.407709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1436/2865] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:34.421807 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:34.424591 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:34.507098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:34.510389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf27aab-bc71-45aa-8999-b4b3662b5390 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:34.516911 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf74b-1bae-4944-b39f-d29509df586a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7724df01ff1444a09a751bb54dabc222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:34.517576 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf74b-1bae-4944-b39f-d29509df586a service glance] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:34.517873 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf74b-1bae-4944-b39f-d29509df586a service glance] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:34.518160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf74b-1bae-4944-b39f-d29509df586a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:34.528662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf74b-1bae-4944-b39f-d29509df586a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:34.530114 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf74b-1bae-4944-b39f-d29509df586a service glance] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:34.539871 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1430/2866] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:44.402525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=20 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:44.535677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=4 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:57.245952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d84081-cf7d-4fe3-9146-c8ba3ce03480 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:57.313331 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d84081-cf7d-4fe3-9146-c8ba3ce03480 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:57.318525 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:57.319401 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:57.319692 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:57.319958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] PATH_INFO: `/v3/users/c0240ec88e4148ea9a688b13afb1a755` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:57.321270 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0240ec88e4148ea9a688b13afb1a755)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:57.323273 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:57.375783 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0240ec88e4148ea9a688b13afb1a755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:57.384194 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0240ec88e4148ea9a688b13afb1a755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:57.396812 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0240ec88e4148ea9a688b13afb1a755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:57.404350 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0240ec88e4148ea9a688b13afb1a755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:57.405047 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0240ec88e4148ea9a688b13afb1a755'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:57.411709 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1437/2867] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:38:57 2022] DELETE /identity/v3/users/c0240ec88e4148ea9a688b13afb1a755 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:57.416793 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:57.417350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:57.417350 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:57.436459 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:57.437658 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:57.511995 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1431/2868] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:57.521961 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:57.523618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:57.581088 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15a0e-702f-4f55-a468-39047ab4a327 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:57.585534 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921ec2-2e53-4570-aa72-bcb5ebfd640e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:57.586201 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921ec2-2e53-4570-aa72-bcb5ebfd640e service neutron] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:57.586511 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921ec2-2e53-4570-aa72-bcb5ebfd640e service neutron] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:57.586789 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921ec2-2e53-4570-aa72-bcb5ebfd640e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:57.596524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf921ec2-2e53-4570-aa72-bcb5ebfd640e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:57.597952 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf921ec2-2e53-4570-aa72-bcb5ebfd640e service neutron] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:57.608208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1438/2869] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:38:57.898662 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:57.900220 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:57.915292 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302a8f6-1e02-42a8-9872-0e46b90e91c5 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:57.920119 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:57.921070 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:57.921309 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:57.921739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] PATH_INFO: `/v3/projects/aa5e44b8512d4352ab8014529dfad543` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:57.922973 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa5e44b8512d4352ab8014529dfad543)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:57.924971 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:57.980562 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa5e44b8512d4352ab8014529dfad543', 'request_id': 'req-b06f558a-8c04-4851-b591-e8464b69fc8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:57.988932 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa5e44b8512d4352ab8014529dfad543', 'request_id': 'req-b06f558a-8c04-4851-b591-e8464b69fc8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:57.996583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa5e44b8512d4352ab8014529dfad543', 'request_id': 'req-b06f558a-8c04-4851-b591-e8464b69fc8c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:58.013124 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] The token cache is being invalidate because project aa5e44b8512d4352ab8014529dfad543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80316) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:38:58.013346 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:58.013958 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-b06f558a-8c04-4851-b591-e8464b69fc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:38:58.015529 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1432/2870] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:38:57 2022] DELETE /identity/v3/projects/aa5e44b8512d4352ab8014529dfad543 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:58.021048 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949a48d-03cd-41a6-9757-9a6d7aff9016 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.021376 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949a48d-03cd-41a6-9757-9a6d7aff9016 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.021683 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949a48d-03cd-41a6-9757-9a6d7aff9016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.040626 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-a949a48d-03cd-41a6-9757-9a6d7aff9016 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:58.041833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-a949a48d-03cd-41a6-9757-9a6d7aff9016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:58.060593 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:58.105914 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1439/2871] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:38:58.113776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd529a1-8483-42c2-a552-4ac4765eda36 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.114084 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd529a1-8483-42c2-a552-4ac4765eda36 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.114345 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd529a1-8483-42c2-a552-4ac4765eda36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.133183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-9cd529a1-8483-42c2-a552-4ac4765eda36 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:58.134410 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9cd529a1-8483-42c2-a552-4ac4765eda36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:58.143117 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1433/2872] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:58.149978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949a48d-03cd-41a6-9757-9a6d7aff9016 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:58.164238 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949a48d-03cd-41a6-9757-9a6d7aff9016 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:58.170152 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:58.170860 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.171142 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.171411 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.172118 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80315) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:38:58.172454 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:58.174091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:58.186524 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1440/2873] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:38:58.190889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd529a1-8483-42c2-a552-4ac4765eda36 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:58.200759 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd529a1-8483-42c2-a552-4ac4765eda36 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:58.207303 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:58.207953 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.208233 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.208587 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.209274 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:58.211215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:58.240178 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1434/2874] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:38:58 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:58.244528 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:58.255516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092325-7d10-41bf-9696-11b35df4b195 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:58.318541 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:58.319225 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.319508 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.319753 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.320468 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:58.322397 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:58.345114 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1441/2875] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:38:58 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:38:58.349495 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:58.360733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20f007-a24b-42be-9826-0dbb20ca7b47 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:58.366478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:58.367152 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.367434 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.367707 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.368456 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:58.370118 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:58.380903 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1435/2876] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:58.384990 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:58.395408 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a72fa3-1419-414e-abc9-a6ec3c403f7a admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:58.400795 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368dea8-bea9-438f-861e-5104427c3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:58.401463 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368dea8-bea9-438f-861e-5104427c3410 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.401762 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368dea8-bea9-438f-861e-5104427c3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.402034 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368dea8-bea9-438f-861e-5104427c3410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.402794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368dea8-bea9-438f-861e-5104427c3410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:58.404405 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368dea8-bea9-438f-861e-5104427c3410 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:58.415092 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1442/2877] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:38:58.420753 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:58.431419 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06994943-e9b2-4701-99d2-3e185e1fd0f6 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:58.436406 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:58.437254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.437533 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.437801 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] PATH_INFO: `/v3/projects/224e01d021444160ab413ea057e28f94/users/e3d27c8707424cfb8894fd8238d50d5c/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.452858 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224e01d021444160ab413ea057e28f94, user_id=e3d27c8707424cfb8894fd8238d50d5c, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:58.455561 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:58.470776 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1436/2878] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:38:58 2022] PUT /identity/v3/projects/224e01d021444160ab413ea057e28f94/users/e3d27c8707424cfb8894fd8238d50d5c/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:38:58.483974 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f725-738e-4371-86ee-6ed314617f5d None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.484335 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f725-738e-4371-86ee-6ed314617f5d None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.484731 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f725-738e-4371-86ee-6ed314617f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.516479 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d7c0f725-738e-4371-86ee-6ed314617f5d None None] MFA Rules not processed for user `e3d27c8707424cfb8894fd8238d50d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:38:58.517705 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d7c0f725-738e-4371-86ee-6ed314617f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:58.608871 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1443/2879] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:38:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:38:58.618687 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:38:58.620536 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:38:58.643652 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:38:58.682080 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f89b3-0c46-4340-94ba-5a37ccdee903 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:38:58.686113 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:38:58.686806 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:38:58.687078 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:38:58.687354 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:38:58.696172 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:38:58.697630 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:38:58.706699 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1437/2880] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:38:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:00.081021 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:00.081564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:00.081564 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:00.102209 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] MFA Rules not processed for user `e3d27c8707424cfb8894fd8238d50d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:00.103452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:00.111423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1444/2881] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:39:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:00.597577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:00.597577 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:00.675122 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3dd7d-c88d-4921-87b3-849f45200ddf service cinder] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:00.680607 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:00.681267 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:00.681550 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:00.681825 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:00.683774 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:00.695612 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:00.697210 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:00.707378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1438/2882] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:07.831502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:07.833591 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:07.848951 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:07.921268 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab96d24-e34a-4c13-a6f3-8d0f1b7e4f60 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:07.927037 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:07.927640 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:07.927945 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:07.928440 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:07.930421 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:07.942522 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:07.944514 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:07.955145 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1445/2883] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:09.812580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:09.831311 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef8e5-187d-4691-bdf0-55e9769094e9 service placement] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:09.837320 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5253b3eec6ae45f3bca9369107c4d93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:09.838249 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:09.838581 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:09.838818 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:09.841526 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:09.855940 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:09.857549 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:09.883521 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1439/2884] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:12.836296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:12.838565 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:12.854503 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc736b-605e-4649-8a88-230e33fee035 service nova] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:12.862471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:12.862471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:12.862471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:12.862471 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:12.863634 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:12.877310 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:12.879569 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:12.907402 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1446/2885] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:16.574180 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:16.586101 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f35768-d959-47e0-9a49-74c41c7c101c service nova] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:16.592066 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03128d-9ac7-4135-b48c-60b9f54eda54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:16.592872 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03128d-9ac7-4135-b48c-60b9f54eda54 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:16.593160 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03128d-9ac7-4135-b48c-60b9f54eda54 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:16.593451 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03128d-9ac7-4135-b48c-60b9f54eda54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:16.595388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-ed03128d-9ac7-4135-b48c-60b9f54eda54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:16.608024 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03128d-9ac7-4135-b48c-60b9f54eda54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:16.609651 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03128d-9ac7-4135-b48c-60b9f54eda54 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:16.623956 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1440/2886] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:16.631414 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:16.633101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:16.712510 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316f7d8-4bd9-4fe5-9fe2-8fc24fece2ea service placement] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:16.717101 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:16.717988 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:16.718266 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:16.718568 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] PATH_INFO: `/v3/users/45eff53f0e6c4ac499d163c36b43dafd` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:16.719778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45eff53f0e6c4ac499d163c36b43dafd)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:16.721672 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:16.774191 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45eff53f0e6c4ac499d163c36b43dafd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:16.781722 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45eff53f0e6c4ac499d163c36b43dafd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:16.794449 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45eff53f0e6c4ac499d163c36b43dafd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:16.801677 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45eff53f0e6c4ac499d163c36b43dafd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:16.802657 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45eff53f0e6c4ac499d163c36b43dafd'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:16.808394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:16.808691 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:16.808974 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:16.809147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1447/2887] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:39:16 2022] DELETE /identity/v3/users/45eff53f0e6c4ac499d163c36b43dafd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:16.876409 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:16.877854 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:16.933857 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=100 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:16.955644 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1441/2888] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:39:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:39:17.001993 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:17.003151 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:17.010475 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:17.011200 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:17.012560 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:17.078002 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10fd43-3d24-489a-9a73-8c0ea2f07759 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:17.082647 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:17.083516 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:17.083796 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:17.084068 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] PATH_INFO: `/v3/projects/6e696ad988884d008e358fd00fd3a2e3` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:17.085241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e696ad988884d008e358fd00fd3a2e3)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:17.087267 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:17.112239 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec92f61-b511-4211-82e2-604e62f23133 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:17.118155 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:17.118863 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:17.119416 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:17.119779 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:17.130111 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:17.131738 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:17.136670 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e696ad988884d008e358fd00fd3a2e3', 'request_id': 'req-e7519d7b-3039-46e2-9545-4bf306c81d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.139870 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1442/2889] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:39:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 17:39:17.145374 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e696ad988884d008e358fd00fd3a2e3', 'request_id': 'req-e7519d7b-3039-46e2-9545-4bf306c81d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.153150 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e696ad988884d008e358fd00fd3a2e3', 'request_id': 'req-e7519d7b-3039-46e2-9545-4bf306c81d80'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.164928 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] The token cache is being invalidate because project 6e696ad988884d008e358fd00fd3a2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:39:17.165340 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.165880 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.168044 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1448/2890] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:39:17 2022] DELETE /identity/v3/projects/6e696ad988884d008e358fd00fd3a2e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:17.171984 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:17.184102 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188211a-76c9-4503-a8d8-85284b3692e7 service swift] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:17.248524 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:17.249478 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:17.249761 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:17.250061 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] PATH_INFO: `/v3/users/4b1b597d3dcd450db9e2691b38b37f77` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:17.251300 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1b597d3dcd450db9e2691b38b37f77)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:17.253224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:17.306207 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1b597d3dcd450db9e2691b38b37f77'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.306981 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1b597d3dcd450db9e2691b38b37f77'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.307727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1b597d3dcd450db9e2691b38b37f77'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.315362 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1b597d3dcd450db9e2691b38b37f77'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.319834 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:17.329622 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-38259aed-da02-4755-a659-64587e7f03ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1b597d3dcd450db9e2691b38b37f77'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.346512 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1443/2891] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:39:17 2022] DELETE /identity/v3/users/4b1b597d3dcd450db9e2691b38b37f77 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:17.522134 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:17.523885 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:17.554241 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7519d7b-3039-46e2-9545-4bf306c81d80 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:17.619380 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:17.620251 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:17.620526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:17.620794 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] PATH_INFO: `/v3/projects/18ec6d2fa3a94ad6a161def80385db05` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:17.621953 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ec6d2fa3a94ad6a161def80385db05)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:17.623917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:17.666035 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:17.669743 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef394-3e99-4767-9aba-65064883f8f6 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:17.670156 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef394-3e99-4767-9aba-65064883f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:17.670291 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ef394-3e99-4767-9aba-65064883f8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:17.677833 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ec6d2fa3a94ad6a161def80385db05', 'request_id': 'req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.687398 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ec6d2fa3a94ad6a161def80385db05', 'request_id': 'req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.689443 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-4f2ef394-3e99-4767-9aba-65064883f8f6 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:17.690677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-4f2ef394-3e99-4767-9aba-65064883f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:17.694409 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ec6d2fa3a94ad6a161def80385db05', 'request_id': 'req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.707864 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] The token cache is being invalidate because project 18ec6d2fa3a94ad6a161def80385db05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:39:17.708242 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.708968 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:17.718400 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1449/2892] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:39:17 2022] DELETE /identity/v3/projects/18ec6d2fa3a94ad6a161def80385db05 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:17.756408 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1444/2893] 10.222.0.50 () {58 vars in 967 bytes} [Tue Jul 12 17:39:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:17.769198 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:17.770803 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:17.862452 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abee8b-0d01-46b6-bd7e-79319fb39d2f admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:17.869601 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:17.870558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:17.870852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:17.871127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:17.883861 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:17.885513 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:17.895749 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1450/2894] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:39:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:39:18.122815 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11b06-f125-4596-be79-8cef62ab8bd4 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:18.123107 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11b06-f125-4596-be79-8cef62ab8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:18.123384 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e11b06-f125-4596-be79-8cef62ab8bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:18.141315 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-b8e11b06-f125-4596-be79-8cef62ab8bd4 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:18.142564 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-b8e11b06-f125-4596-be79-8cef62ab8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:18.150394 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1445/2895] 10.222.0.50 () {58 vars in 1009 bytes} [Tue Jul 12 17:39:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 17:39:18.162223 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:18.173427 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc23f3-3dc3-4c06-a78a-cc7e1557e51c service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:18.179477 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:18.180119 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:18.180394 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:18.180824 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:18.189602 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:18.191211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:18.200428 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1451/2896] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:39:18.534945 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:18.535235 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:18.535506 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:18.554580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] MFA Rules not processed for user `c2841ffed5bb4257b20a5e88271d6979`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:18.555760 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:18.564340 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1446/2897] 10.222.0.50 () {58 vars in 967 bytes} [Tue Jul 12 17:39:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:18.576810 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:18.589384 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d4788-9e8d-4cd0-b715-2f93a7011ec2 service swift] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:18.595323 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46439e0d-edbb-4f41-96aa-341d83029467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5731c3ee4a284ae085eedd600c21bc39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:18.595979 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439e0d-edbb-4f41-96aa-341d83029467 service swift] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:18.596260 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439e0d-edbb-4f41-96aa-341d83029467 service swift] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:18.596537 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46439e0d-edbb-4f41-96aa-341d83029467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:18.606425 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439e0d-edbb-4f41-96aa-341d83029467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:18.608063 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46439e0d-edbb-4f41-96aa-341d83029467 service swift] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:18.616577 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1452/2898] 10.222.0.50 () {60 vars in 1384 bytes} [Tue Jul 12 17:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 17:39:20.769800 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:20.771486 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:20.843147 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b6d5f-9d48-40f7-b06a-b33358b297a3 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:20.848254 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:20.849157 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:20.849442 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:20.850073 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] PATH_INFO: `/v3/users/e3d27c8707424cfb8894fd8238d50d5c` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:20.851357 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d27c8707424cfb8894fd8238d50d5c)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:20.853580 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:20.908383 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d27c8707424cfb8894fd8238d50d5c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:20.909035 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d27c8707424cfb8894fd8238d50d5c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:20.909647 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d27c8707424cfb8894fd8238d50d5c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:20.916963 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d27c8707424cfb8894fd8238d50d5c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:20.928002 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:20.929441 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d27c8707424cfb8894fd8238d50d5c'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:20.945921 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1447/2899] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:39:20 2022] DELETE /identity/v3/users/e3d27c8707424cfb8894fd8238d50d5c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:20.950869 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:20.951359 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:20.951526 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:20.970216 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:20.971443 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:21.032451 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1453/2900] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:21.045741 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.048169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:21.111161 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010676b-43fc-49e4-bf4f-56541974a758 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.115727 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201eb60-1672-4996-b554-aef0869ba425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.116387 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb60-1672-4996-b554-aef0869ba425 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.116671 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb60-1672-4996-b554-aef0869ba425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.116946 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201eb60-1672-4996-b554-aef0869ba425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.127282 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201eb60-1672-4996-b554-aef0869ba425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.128749 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201eb60-1672-4996-b554-aef0869ba425 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.138843 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1448/2901] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:21.318917 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.321132 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:21.334729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a039f-1ca7-4ba0-b862-7cdb01631827 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.340598 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.341558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.341898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.342167 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] PATH_INFO: `/v3/projects/224e01d021444160ab413ea057e28f94` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.343641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224e01d021444160ab413ea057e28f94)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.345778 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.375296 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:21.401094 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224e01d021444160ab413ea057e28f94', 'request_id': 'req-d9d6b234-d900-4863-acba-e5e5fb3dce73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:21.410550 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224e01d021444160ab413ea057e28f94', 'request_id': 'req-d9d6b234-d900-4863-acba-e5e5fb3dce73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:21.416852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224e01d021444160ab413ea057e28f94', 'request_id': 'req-d9d6b234-d900-4863-acba-e5e5fb3dce73'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:21.428051 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] The token cache is being invalidate because project 224e01d021444160ab413ea057e28f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:39:21.428342 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:21.429057 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-d9d6b234-d900-4863-acba-e5e5fb3dce73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:21.430808 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1454/2902] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:39:21 2022] DELETE /identity/v3/projects/224e01d021444160ab413ea057e28f94 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:21.436356 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee05e-e759-44ef-bcc9-f99a8c7e9bbd None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.436669 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee05e-e759-44ef-bcc9-f99a8c7e9bbd None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.437060 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bee05e-e759-44ef-bcc9-f99a8c7e9bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.458028 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-74bee05e-e759-44ef-bcc9-f99a8c7e9bbd None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:21.459287 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-74bee05e-e759-44ef-bcc9-f99a8c7e9bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:21.519983 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1449/2903] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:21.528533 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdaf4e-cf0d-4226-b8bf-ef1d14b5cd22 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.528852 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdaf4e-cf0d-4226-b8bf-ef1d14b5cd22 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.529127 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdaf4e-cf0d-4226-b8bf-ef1d14b5cd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.548091 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-8dfdaf4e-cf0d-4226-b8bf-ef1d14b5cd22 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:21.549415 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-8dfdaf4e-cf0d-4226-b8bf-ef1d14b5cd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:21.559112 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1455/2904] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:21.563583 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bee05e-e759-44ef-bcc9-f99a8c7e9bbd None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.573729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bee05e-e759-44ef-bcc9-f99a8c7e9bbd None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.579098 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.579767 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.580052 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.580328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.581066 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80316) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 17:39:21.581377 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.583043 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.595261 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1450/2905] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Jul 12 17:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 17:39:21.600221 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdaf4e-cf0d-4226-b8bf-ef1d14b5cd22 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.609767 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdaf4e-cf0d-4226-b8bf-ef1d14b5cd22 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.614825 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.615484 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.615768 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.616040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.616729 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.618676 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.651964 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1456/2906] 10.222.0.50 () {60 vars in 1152 bytes} [Tue Jul 12 17:39:21 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 17:39:21.657123 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.668129 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8f7cd-b74d-4f19-8a8e-3c2732937e59 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.729231 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.729901 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.730183 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.730476 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.731171 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.733100 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.755000 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1451/2907] 10.222.0.50 () {60 vars in 1143 bytes} [Tue Jul 12 17:39:21 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 17:39:21.761900 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.776282 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc9c0f-c050-45fc-811f-61beceb6b8b4 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.781172 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.781832 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.782115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.782423 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.783147 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.784754 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.795809 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1457/2908] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:39:21.799682 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.810462 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db95f66-e18d-411d-a677-31af895776a1 admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.815729 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac0bb-1899-4150-bdc0-99e98d2d593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.816395 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac0bb-1899-4150-bdc0-99e98d2d593c admin admin] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.816677 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac0bb-1899-4150-bdc0-99e98d2d593c admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.816949 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac0bb-1899-4150-bdc0-99e98d2d593c admin admin] PATH_INFO: `/v3/roles` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.817683 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ac0bb-1899-4150-bdc0-99e98d2d593c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.819363 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ac0bb-1899-4150-bdc0-99e98d2d593c admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.821378 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:21.832275 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1452/2909] 10.222.0.50 () {58 vars in 1121 bytes} [Tue Jul 12 17:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 17:39:21.836115 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:21.852154 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8737-7276-491f-bb16-5f054cfc4827 admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:21.861211 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:21.862641 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.863015 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.863389 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] PATH_INFO: `/v3/projects/7339fe0417264dada96e654fa3f0ef97/users/a0646ac23d8943e99f0f2b71352fdef7/roles/6b8632a7626e453996fdfe3232c95d66` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.881502 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7339fe0417264dada96e654fa3f0ef97, user_id=a0646ac23d8943e99f0f2b71352fdef7, role_id=6b8632a7626e453996fdfe3232c95d66)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:21.884220 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:21.899558 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1458/2910] 10.222.0.50 () {60 vars in 1482 bytes} [Tue Jul 12 17:39:21 2022] PUT /identity/v3/projects/7339fe0417264dada96e654fa3f0ef97/users/a0646ac23d8943e99f0f2b71352fdef7/roles/6b8632a7626e453996fdfe3232c95d66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:21.910215 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b338de-9b4a-4c48-844b-35536d1f8c01 None None] REQUEST_METHOD: `POST` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:21.910511 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b338de-9b4a-4c48-844b-35536d1f8c01 None None] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:21.910794 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b338de-9b4a-4c48-844b-35536d1f8c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:21.939163 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.auth.core [None req-d8b338de-9b4a-4c48-844b-35536d1f8c01 None None] MFA Rules not processed for user `a0646ac23d8943e99f0f2b71352fdef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80316) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:21.940389 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-d8b338de-9b4a-4c48-844b-35536d1f8c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:22.010954 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1453/2911] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:39:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:22.023046 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:22.025011 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:22.086694 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175fcd-223a-4645-90bb-6c6452021f3c admin admin] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:22.091392 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb86c9-767b-476c-ade6-540c8f57277c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c30dd51dbbb245a485be48fce34295e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:22.092040 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb86c9-767b-476c-ade6-540c8f57277c service cinder] REQUEST_METHOD: `GET` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:22.092319 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb86c9-767b-476c-ade6-540c8f57277c service cinder] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:22.092723 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb86c9-767b-476c-ade6-540c8f57277c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:22.102481 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb86c9-767b-476c-ade6-540c8f57277c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:22.104105 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb86c9-767b-476c-ade6-540c8f57277c service cinder] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:22.113237 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1459/2912] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:39:27.166588 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b338de-9b4a-4c48-844b-35536d1f8c01 None None] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:27.230584 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b338de-9b4a-4c48-844b-35536d1f8c01 None None] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:27.236169 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:27.237071 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:27.237328 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:27.237629 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] PATH_INFO: `/v3/users/a0646ac23d8943e99f0f2b71352fdef7` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:27.238885 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0646ac23d8943e99f0f2b71352fdef7)` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:27.240822 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:27.297482 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0646ac23d8943e99f0f2b71352fdef7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.298224 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0646ac23d8943e99f0f2b71352fdef7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.298936 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0646ac23d8943e99f0f2b71352fdef7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.306608 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0646ac23d8943e99f0f2b71352fdef7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.319733 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.notifications [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0646ac23d8943e99f0f2b71352fdef7'} {{(pid=80316) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.333694 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1454/2913] 10.222.0.50 () {58 vars in 1223 bytes} [Tue Jul 12 17:39:27 2022] DELETE /identity/v3/users/a0646ac23d8943e99f0f2b71352fdef7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:27.338388 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] REQUEST_METHOD: `POST` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:27.338876 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:27.338978 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:27.357618 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.auth.core [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] MFA Rules not processed for user `8c091920114540d88a55ece0ae3e28cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80315) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 17:39:27.358849 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:27.415898 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:27.434906 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1460/2914] 10.222.0.50 () {58 vars in 957 bytes} [Tue Jul 12 17:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 17:39:27.447388 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:27.449449 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:27.459933 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:27.511329 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557758bf-4733-40e6-a5d1-7e4058bc5c7f admin admin] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:27.515306 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '164446c4b65e4043a492dc626a571e81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:27.515962 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:27.516245 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:27.516520 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:27.526201 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:27.527882 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:27.538452 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1455/2915] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 17:39:27.824069 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] Authenticating user token {{(pid=80315) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:39:27.825946 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.fernet_utils [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80315) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:39:27.840571 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a3d7f-72f6-4ecd-a7a5-3b748480f0b2 None None] Validating token access rules against request {{(pid=80315) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:39:27.846326 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c091920114540d88a55ece0ae3e28cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7ba288325ae4db7b10fd752229e632e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80315) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:39:27.847208 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:39:27.847493 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:39:27.847788 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] PATH_INFO: `/v3/projects/7339fe0417264dada96e654fa3f0ef97` {{(pid=80315) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:39:27.848958 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7339fe0417264dada96e654fa3f0ef97)` {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:39:27.851382 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] RBAC: Authorization granted {{(pid=80315) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:39:27.898562 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7339fe0417264dada96e654fa3f0ef97', 'request_id': 'req-90fde286-bc69-49d3-a29b-661db4b21ad5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.906843 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7339fe0417264dada96e654fa3f0ef97', 'request_id': 'req-90fde286-bc69-49d3-a29b-661db4b21ad5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.912353 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7339fe0417264dada96e654fa3f0ef97', 'request_id': 'req-90fde286-bc69-49d3-a29b-661db4b21ad5'} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.925235 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] The token cache is being invalidate because project 7339fe0417264dada96e654fa3f0ef97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80315) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 17:39:27.925407 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.926271 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG keystone.notifications [None req-90fde286-bc69-49d3-a29b-661db4b21ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80315) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 17:39:27.928003 dv-cinder-849325-2-smb devstack@keystone.service[80315]: [pid: 80315|app: 0|req: 1461/2916] 10.222.0.50 () {58 vars in 1232 bytes} [Tue Jul 12 17:39:27 2022] DELETE /identity/v3/projects/7339fe0417264dada96e654fa3f0ef97 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 17:39:37.534266 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=23 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:39:37.921566 dv-cinder-849325-2-smb devstack@keystone.service[80315]: DEBUG dbcounter [-] [80315] Writing DB stats keystone:SELECT=32,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80315) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 17:41:20.705450 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] Authenticating user token {{(pid=80316) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 17:41:20.707063 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:41:20.779401 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4bc2a-ac90-41d3-9677-adb9a5801254 service neutron] Validating token access rules against request {{(pid=80316) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 17:41:20.849980 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739af1b-b7cc-4c0a-9223-268b4b91ed38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76f25ce386864d6f9090154cb210807a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a2dd148c72e44c6ada9496cd6fda081', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80316) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 17:41:20.850603 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739af1b-b7cc-4c0a-9223-268b4b91ed38 service placement] REQUEST_METHOD: `GET` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 17:41:20.850889 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739af1b-b7cc-4c0a-9223-268b4b91ed38 service placement] SCRIPT_NAME: `/identity` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 17:41:20.851166 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739af1b-b7cc-4c0a-9223-268b4b91ed38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80316) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 17:41:20.853112 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.fernet_utils [None req-9739af1b-b7cc-4c0a-9223-268b4b91ed38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80316) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 17:41:20.865514 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739af1b-b7cc-4c0a-9223-268b4b91ed38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 17:41:20.867136 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739af1b-b7cc-4c0a-9223-268b4b91ed38 service placement] RBAC: Authorization granted {{(pid=80316) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 17:41:20.877530 dv-cinder-849325-2-smb devstack@keystone.service[80316]: [pid: 80316|app: 0|req: 1456/2917] 10.222.0.50 () {60 vars in 1365 bytes} [Tue Jul 12 17:41:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 17:41:30.873739 dv-cinder-849325-2-smb devstack@keystone.service[80316]: DEBUG dbcounter [-] [80316] Writing DB stats keystone:SELECT=58 {{(pid=80316) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}